-- Logs begin at Thu 2022-05-12 13:39:07 UTC, end at Thu 2022-05-12 15:06:27 UTC. -- May 12 14:38:24.523036 dv-cinder-831187-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 12 14:38:24.532099 dv-cinder-831187-2-iscsi devstack@n-api.service[87442]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 12 14:38:24.534174 dv-cinder-831187-2-iscsi devstack@n-api.service[87442]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 12 14:38:24 2022] *** May 12 14:38:24.534174 dv-cinder-831187-2-iscsi devstack@n-api.service[87442]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 12 14:38:24.534174 dv-cinder-831187-2-iscsi devstack@n-api.service[87442]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 12 14:38:24.534174 dv-cinder-831187-2-iscsi devstack@n-api.service[87442]: nodename: dv-cinder-831187-2-iscsi May 12 14:38:24.534174 dv-cinder-831187-2-iscsi devstack@n-api.service[87442]: machine: x86_64 May 12 14:38:24.534174 dv-cinder-831187-2-iscsi devstack@n-api.service[87442]: clock source: unix May 12 14:38:24.534174 dv-cinder-831187-2-iscsi devstack@n-api.service[87442]: pcre jit disabled May 12 14:38:24.534174 dv-cinder-831187-2-iscsi devstack@n-api.service[87442]: detected number of CPU cores: 4 May 12 14:38:24.534174 dv-cinder-831187-2-iscsi devstack@n-api.service[87442]: current working directory: / May 12 14:38:24.534174 dv-cinder-831187-2-iscsi devstack@n-api.service[87442]: detected binary path: /usr/bin/uwsgi-core May 12 14:38:24.534912 dv-cinder-831187-2-iscsi devstack@n-api.service[87442]: your processes number limit is 47680 May 12 14:38:24.534912 dv-cinder-831187-2-iscsi devstack@n-api.service[87442]: your memory page size is 4096 bytes May 12 14:38:24.534912 dv-cinder-831187-2-iscsi devstack@n-api.service[87442]: detected max file descriptor number: 2048 May 12 14:38:24.534912 dv-cinder-831187-2-iscsi devstack@n-api.service[87442]: lock engine: pthread robust mutexes May 12 14:38:24.534912 dv-cinder-831187-2-iscsi devstack@n-api.service[87442]: thunder lock: enabled May 12 14:38:24.534912 dv-cinder-831187-2-iscsi devstack@n-api.service[87442]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 12 14:38:24.534912 dv-cinder-831187-2-iscsi devstack@n-api.service[87442]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 12 14:38:24.582009 dv-cinder-831187-2-iscsi devstack@n-api.service[87442]: Python main interpreter initialized at 0x55cbb07f09c0 May 12 14:38:24.582009 dv-cinder-831187-2-iscsi devstack@n-api.service[87442]: python threads support enabled May 12 14:38:24.582009 dv-cinder-831187-2-iscsi devstack@n-api.service[87442]: your server socket listen backlog is limited to 100 connections May 12 14:38:24.582009 dv-cinder-831187-2-iscsi devstack@n-api.service[87442]: your mercy for graceful operations on workers is 90 seconds May 12 14:38:24.582360 dv-cinder-831187-2-iscsi devstack@n-api.service[87442]: mapped 403077 bytes (393 KB) for 2 cores May 12 14:38:24.582437 dv-cinder-831187-2-iscsi devstack@n-api.service[87442]: *** Operational MODE: preforking *** May 12 14:38:24.582703 dv-cinder-831187-2-iscsi devstack@n-api.service[87442]: *** uWSGI is running in multiple interpreter mode *** May 12 14:38:24.582703 dv-cinder-831187-2-iscsi devstack@n-api.service[87442]: spawned uWSGI master process (pid: 87442) May 12 14:38:24.582936 dv-cinder-831187-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 12 14:38:24.584806 dv-cinder-831187-2-iscsi devstack@n-api.service[87442]: spawned uWSGI worker 1 (pid: 87443, cores: 1) May 12 14:38:24.584806 dv-cinder-831187-2-iscsi devstack@n-api.service[87442]: spawned uWSGI worker 2 (pid: 87444, cores: 1) May 12 14:38:24.584806 dv-cinder-831187-2-iscsi devstack@n-api.service[87442]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 12 14:38:28.672036 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 12 14:38:28.673290 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 12 14:38:28.673290 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 12 14:38:28.673617 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 12 14:38:28.673872 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 12 14:38:28.674213 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 12 14:38:28.674594 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.674675 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 12 14:38:28.674751 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.674888 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.674970 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 12 14:38:28.675197 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.675311 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 12 14:38:28.675524 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.675611 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 12 14:38:28.675839 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.675932 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.676149 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.676242 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.676464 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.676555 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.676790 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.676882 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.677047 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.677180 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.677356 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.677491 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.677676 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-831187-2-iscsi {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.677813 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.677993 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.678133 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.678297 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.678463 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.678605 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.678696 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.678941 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.679043 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.679246 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.679331 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-831187-2-iscsi {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.679565 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.679661 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.679866 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.679960 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.680234 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.680357 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.680746 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.680873 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.680976 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.681092 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.681213 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.681366 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.681483 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.681698 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.681931 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.682081 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.682241 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.682366 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.682547 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.682670 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.682925 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.683064 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.683248 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.683372 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.683554 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.683684 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.683871 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-831187-2-iscsi {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.684002 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.684182 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.684304 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.684491 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.684612 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.684799 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.684922 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.685109 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.685238 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.685428 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-831187-2-iscsi {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.685560 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.685741 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.685864 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.686077 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.686211 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.686362 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.686499 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.686695 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.686838 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.687041 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.687175 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.687355 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.687480 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.687669 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.687809 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.687984 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.688111 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.688301 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.688950 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.689125 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.689250 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.689434 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.689586 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.689750 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.689887 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.690053 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.690178 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.690355 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.690484 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.690611 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.690750 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.690905 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.691027 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.691229 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.691355 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.691546 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.691679 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.691864 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.691992 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.692110 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.692226 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.692356 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.692477 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.692651 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.692776 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.692966 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.693096 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.693271 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.693398 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.693559 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.693682 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.693801 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.693929 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.694115 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.694239 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.694434 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.694559 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.694734 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.694887 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.695061 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.695194 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.695366 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.695491 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.695671 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.695802 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.695978 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.696122 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.696306 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.696430 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.696560 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.696680 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.696872 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.696996 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.697192 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.697317 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.697493 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.697617 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.697799 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.697923 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.698110 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.698231 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.698430 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.698555 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.698733 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.698873 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.699081 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.699213 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.699390 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.699523 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.699692 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.699813 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.699996 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.700129 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.700300 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.700425 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.700614 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.700738 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.700934 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.701064 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.701232 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.701360 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.701480 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.701599 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.701764 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.701896 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.702065 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.702188 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.702377 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.702507 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.702680 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.702858 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.702991 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.703117 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.703294 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.703417 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.703589 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.703720 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.703908 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.704036 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.704219 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.704351 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.704547 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.704670 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.704814 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.704938 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.705112 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.705232 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.705412 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.705534 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.705715 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.705870 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.706019 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.706144 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.706341 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.706472 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.706638 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.706774 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.706969 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.707096 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.707272 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.707395 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.707575 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.707698 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.707876 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.708003 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.708178 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.708309 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.708491 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.708622 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.708794 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.708925 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.709095 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.709220 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.709398 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.709520 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.709701 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.709843 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.710003 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.710129 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.710315 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.710443 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.710616 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.710747 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.710939 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.711066 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.711254 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.711386 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.711550 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.711681 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.711888 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.712025 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.712146 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.712265 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.712453 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.712585 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.712752 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.712875 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.713053 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.713180 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.713352 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.713485 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.713651 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.713797 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.713953 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.714119 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.714242 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.714375 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.714539 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.714663 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.714856 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.714998 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.715160 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.715294 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.715448 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.715573 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.715752 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.715876 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.716053 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.716176 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.716351 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.716487 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.716669 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.716799 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.716987 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.717109 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.717296 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.717420 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.717605 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.717728 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.717911 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.718042 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.718228 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:38:28.718352 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.718562 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.718686 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.718900 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.719026 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.719211 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.719343 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.719540 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.719674 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.719868 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.719992 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.720178 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.720309 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.720489 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.720626 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.720799 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.720922 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.721114 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.721245 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.721429 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.721561 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.721743 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.721865 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.722056 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.722186 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.722369 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.722504 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.722686 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.722849 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.723019 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.723141 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.723333 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.723458 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.723655 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.723780 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.723973 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.724145 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.724274 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.724402 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.724594 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.724723 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.724913 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.725037 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.725235 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.725356 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.725535 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.725659 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.725849 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.725971 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.726159 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.726282 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.726471 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.726621 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.726782 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.726982 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.727122 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.727311 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.727435 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.727637 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.727760 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.727953 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.728086 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.728268 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.728392 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.728585 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.728709 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.728909 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.729043 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.729217 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.729346 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.729525 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.729649 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.729844 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.729973 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.730156 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.730278 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.730466 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.730594 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.730774 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.730947 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.731113 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.731236 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.731422 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.731543 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.731731 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.731864 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.732039 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.732164 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.732344 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.732467 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.732647 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.732772 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.732950 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.733081 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.733259 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.733391 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.733561 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.733686 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.733872 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.734000 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.734181 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.734315 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.734482 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.734604 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.734786 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.734975 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.735121 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.735757 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.735951 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.736081 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.736274 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.736400 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.736575 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.736702 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.736886 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.737009 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.737202 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.737327 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.737506 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.737638 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.737816 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.737945 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.738125 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.738254 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.738429 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.738554 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.738744 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.738909 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.739074 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.739223 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.739425 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.739551 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.739671 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.739789 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.739971 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.740105 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.740282 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.740408 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.740591 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.740722 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.740896 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.741018 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.741203 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.741328 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.741509 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.741633 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.741827 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.741956 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.742142 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.742267 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.742444 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.742574 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.742767 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.742925 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.743110 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.743234 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.743423 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.743553 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.743722 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.743854 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.744032 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.744157 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.744334 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.744458 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.744635 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.744769 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.744935 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.745067 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.745240 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.745365 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.745539 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.745676 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.745840 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.745973 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.746139 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.746264 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.746438 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.746563 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.746736 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.746906 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.747084 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.747209 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.747390 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.747523 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.747691 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.747815 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.747991 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.748122 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.748289 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.748415 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.748626 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.748755 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.748911 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.749043 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.749221 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.749354 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.749529 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.749657 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.749833 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.749957 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.750138 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.750256 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.750443 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.750566 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.750746 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.750941 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.751114 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.751735 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.751935 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.752061 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.752256 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.752388 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.752560 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.752685 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.752871 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.752996 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.753172 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.753304 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.753479 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.753610 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.753788 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.753911 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.754114 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.754246 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.754419 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.754541 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.754726 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.754885 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.755057 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.755259 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.755384 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.755503 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.755659 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.755783 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.755968 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.756094 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.756271 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.756395 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.756571 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.756695 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.756881 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.757013 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.757191 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.757315 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.757498 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.757621 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.757809 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.757933 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.758112 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.758233 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.758417 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.758545 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.758720 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.758865 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.759049 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.759173 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.759354 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.759485 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.759664 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.759788 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.759969 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.760093 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.760279 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.760409 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.760586 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.760708 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.760894 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.761017 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.761199 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.761511 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.761636 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.761841 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.762074 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.762199 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.762460 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.762591 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.762782 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.763024 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.763146 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.763265 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.763406 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.763547 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.763718 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.763847 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.764028 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.764149 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.764335 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.764467 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.764640 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.764770 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.764945 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.765069 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.765268 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.765392 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.765579 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.765704 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.765883 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.766006 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.766193 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.766317 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.766540 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.766672 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.766947 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.767080 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.767214 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.767341 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.767501 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.767624 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.767809 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.767932 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.768121 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.768246 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.768432 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.768555 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.768739 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.768871 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.769052 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.769182 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.769360 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.769489 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.769669 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.769799 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.769974 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.770096 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.770532 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.770656 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.770865 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.771005 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.771181 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.771304 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.771492 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.771742 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.771872 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.772072 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.772198 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.772387 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.772510 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.772707 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.772949 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.773075 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.773284 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.773415 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.773602 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.773723 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.773910 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.774043 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.774233 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.774359 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.774545 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.774667 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.774877 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.775006 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.775185 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.775308 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.775489 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.775623 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.775800 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.775925 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.776106 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.776231 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.776410 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.776545 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.776711 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.776843 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.777055 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.777186 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.777308 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.777443 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.777609 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.777735 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.777911 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.778035 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.778214 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.778351 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.778517 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.778640 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.778842 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.778969 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.779147 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.779284 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.779450 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.779573 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.779763 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.779885 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.780068 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.780202 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.780370 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.780494 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.780672 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.780803 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.780975 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.781100 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.781288 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.781411 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.781596 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.781710 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.781907 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.782008 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.782237 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.782325 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.782584 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.782680 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.782920 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.783011 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.783226 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.783310 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.783550 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.783639 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.783853 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.783941 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.784155 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.784251 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.784466 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.784554 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.784775 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.784874 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.785076 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.785195 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.785384 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.785484 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.785692 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.785779 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.786001 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.786088 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.786301 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.786386 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.786610 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.786705 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.786940 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.787032 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.787255 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.787354 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.787554 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.787648 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.787855 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.787949 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.788155 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.788250 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.788462 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.788549 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.788765 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.788851 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.789064 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.789161 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.789366 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.789460 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.789677 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.789763 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.789976 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.790061 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.790278 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.790373 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.790578 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.790678 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.790904 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.791002 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.791215 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.791313 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.791525 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.791622 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.791836 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.791921 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.792138 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.792233 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.792447 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.792531 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.792749 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.792834 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.793052 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.793152 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.793356 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.793450 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.793663 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.793749 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.793966 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.794060 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.794266 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.794358 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.794567 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.794652 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.794894 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.794986 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.795199 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.795285 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.795504 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.795598 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.795807 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.795894 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.796108 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.796193 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.796407 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.796492 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.796708 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.796794 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.797025 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.797118 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.797333 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.797440 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.798156 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.798249 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.798481 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.798568 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.798835 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.798935 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.799143 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.799228 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.799452 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.799536 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.799761 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.799856 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.800074 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.800161 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.800378 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.800464 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.800689 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.800781 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.800998 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.801093 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.801308 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.801393 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.801610 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.801704 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.801913 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.802007 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.802227 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.802311 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.802535 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.802622 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.802864 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.802955 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.803173 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.803274 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.803494 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.803583 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.803808 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.803895 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.804109 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.804195 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.804419 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.804507 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.804730 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.804817 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.805039 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.805124 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.805342 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.805436 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.805648 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.805734 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.805958 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.806043 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.806265 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.806351 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.806572 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.806658 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.806906 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.807008 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.807219 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.807305 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.807533 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.807676 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.807840 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.807997 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.808149 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.808312 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.808454 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.808626 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.808774 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.808938 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.809085 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.809252 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.809386 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.809565 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.809693 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.809873 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.809999 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.810199 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.810308 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.810511 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.810606 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.810852 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.811043 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.811155 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.811355 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.811465 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.811667 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.811763 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.811972 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.812058 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.812286 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.812491 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.812591 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.812807 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.812894 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.813120 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.813244 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.813986 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.814092 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.814305 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.814452 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.814619 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.814768 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.814966 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.815122 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.815282 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.815434 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.815589 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.815740 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.816008 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.816103 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.816326 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.816412 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.816638 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.816724 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.816944 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.817031 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.817248 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.817333 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.817558 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.817673 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.817940 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.818033 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.818172 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.818289 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.818475 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.818562 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.818779 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.818915 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.819110 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.819230 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.819434 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.819530 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.819740 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.819934 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.820062 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.820246 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.820482 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.820576 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.820797 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.820891 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.821107 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.821202 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.821480 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.821573 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.821785 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.821873 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.822097 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.822197 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.822408 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.822509 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.822728 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.822872 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.823072 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.823168 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.823380 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.823467 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.823692 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.823779 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.823998 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.824099 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.824317 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.824404 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.824637 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.824722 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.824950 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.825036 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.825266 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.825354 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.825574 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.825668 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.825900 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.825987 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.826223 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.826318 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.826538 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.826626 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.826883 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.826986 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.827223 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.827365 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.827536 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.827706 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.827898 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.828010 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.828157 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.828331 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.828461 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.828661 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.828785 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.828993 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.829116 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.829302 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.829428 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.829615 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.829739 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.829924 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.830048 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.830230 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.830353 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.830553 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.830650 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.830883 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.831002 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.831200 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.831307 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.831512 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.831611 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.831822 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.831909 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.832129 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.832256 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.832439 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.832600 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.832763 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.832858 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.833067 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.833153 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.833387 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.833489 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.833701 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.833787 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.834007 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.834092 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.834314 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.834409 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.834624 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.834717 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.834970 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.835062 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.835282 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.835381 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.835590 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.835677 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.835894 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.835982 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.836200 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.836295 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.836537 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.836647 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.836841 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.836929 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.837163 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.837250 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.837483 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.837570 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.837810 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.837911 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.838112 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.838213 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.838413 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.838515 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.838723 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.838826 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.839051 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.839140 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.839354 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.839444 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.839656 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.839744 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.839963 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.840050 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.840265 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.840361 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.840566 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.840654 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.840869 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.840965 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.841173 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.841307 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.841478 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.841573 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.841789 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.841889 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.842093 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.842191 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.842394 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.842488 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.842695 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.842892 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.843020 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.843107 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.843359 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.843447 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.843664 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.843760 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.843995 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.844083 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.844314 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.844415 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.844642 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.844745 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.844950 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.845041 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.845271 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.845450 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.845599 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.845952 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.846040 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.846269 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.846541 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.846628 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.846892 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.846988 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.847213 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.847288 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.847534 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.847622 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.847867 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.848006 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.848146 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.848242 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.848458 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.848547 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.848774 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.848912 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.849088 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.849174 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.849406 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.849604 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.849726 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.849938 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.850033 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.850258 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.850345 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.850574 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.850671 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.850912 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.851004 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.851236 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.851360 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.851549 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.851646 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.851864 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.852084 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.852171 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.852424 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.852520 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.852745 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.852833 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.853063 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.853150 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.853377 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.853473 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.853698 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.853785 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.854012 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.854098 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.854326 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.854415 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.854640 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.854744 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.854980 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.855074 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.855300 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.855390 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.855628 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.855714 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.855957 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.856053 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.856262 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.856356 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.856581 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.856668 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.856900 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.856997 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.857218 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.857316 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.857532 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.857625 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.857844 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.857943 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.858158 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.858290 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.858475 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.858564 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.858792 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.858929 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.859123 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.859211 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.859438 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.859526 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.859750 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.859839 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.860065 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.860657 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.860913 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.861014 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.861232 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.861319 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.861552 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.861639 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.861865 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.861960 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.862178 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.862264 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.862494 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.862691 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.862835 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.863037 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.863185 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.863369 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.863528 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.863694 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.863852 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.864018 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.864168 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.864333 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.864484 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.864650 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.864798 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.864977 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.865285 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.865379 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.865591 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.865683 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.865903 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.865992 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.866214 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.866301 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.866522 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.866610 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.866864 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.866958 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.867180 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.867269 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.867488 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.867584 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.867810 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.867903 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.868127 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.868228 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.868441 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.868653 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.868758 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.868998 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.869086 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.869315 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.869402 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.869639 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.869728 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.869957 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.870043 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.870270 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.870365 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.870576 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.870678 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.870925 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.871147 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.871250 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.871494 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.871635 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.871814 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.871901 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.872122 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.872220 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.872426 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.872528 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.872731 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.872819 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.873042 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.873131 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.873352 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.873443 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.873661 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.873777 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.873962 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.874058 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.874265 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.874360 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.874579 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.874679 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.874910 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.875030 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.875218 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.875340 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.875521 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.875654 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.876371 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.876519 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.876689 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.876831 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.876994 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.877146 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.877299 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.877455 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.877784 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.877873 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.878088 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.878173 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.878395 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.878490 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.878702 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.878790 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.879031 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.879121 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.879337 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.879434 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.879643 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.879729 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.879947 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.880040 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.880249 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.880430 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.880569 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.880749 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.880875 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.881058 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.881178 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.881373 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.881492 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.881680 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.881804 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.881994 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.882123 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.882301 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.882438 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.882615 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.882750 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.882946 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.883125 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.883271 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.883445 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.883577 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.883881 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.883966 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.884196 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.884285 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.884508 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.884604 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.884830 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.884938 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.885143 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.885279 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.885456 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.885586 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.885802 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.885902 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.886121 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.886208 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.886496 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.886657 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.886824 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.887028 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.887141 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.887352 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.887448 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.887695 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.887782 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.888035 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.888125 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.888344 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.888433 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.888654 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.888748 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.888961 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.889048 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.889270 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.889359 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.889582 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.889680 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.889892 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.889986 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.890204 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.890298 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.890516 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.890610 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.890851 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.890953 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.891162 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.891250 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.891499 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.891596 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.891811 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.891898 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.892122 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.892210 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.892432 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.892531 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.892747 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.892834 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.893059 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.893146 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.893367 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.893501 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.893685 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.893773 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.894012 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.894098 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.894326 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.894420 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.894633 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.894720 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.894984 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.895083 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.895551 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.895648 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.895877 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.895964 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.896188 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.896284 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.896498 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.896585 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.896815 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.896902 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.897144 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.897240 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.897459 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.897546 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.897767 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.897854 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.898099 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.898194 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.898406 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.898544 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.898710 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.898805 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.899047 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.899138 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.899389 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.899479 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.899722 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.899812 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.900041 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.900137 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.900362 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.900451 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.900694 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.900782 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.901003 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.901091 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.901311 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.901398 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.901619 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.901706 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.901928 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.902024 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.902239 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.902327 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.902558 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.902654 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.902900 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.903027 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.903221 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.903318 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.903533 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.903698 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.903855 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.903945 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.904165 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.904252 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.904477 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.904572 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.904782 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.904878 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.905094 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.905179 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.905403 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.905498 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.905717 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.905813 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.906036 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.906121 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.906348 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.906445 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.906666 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.906760 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.907016 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.907115 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.907350 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.907439 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.907658 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.907745 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.907974 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.908060 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.908289 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.908384 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.908602 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.908688 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.908912 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.908999 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.909235 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.909322 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.909544 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.909631 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.909857 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.909944 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.910167 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.910255 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.910477 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.910563 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.910784 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.910914 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.911118 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.911207 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.911445 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.911534 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.911756 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.911849 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.912065 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.912151 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.912386 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.912474 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.912702 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.912796 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.913015 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.913154 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.913327 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.913418 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.913637 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.913733 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.913951 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.914038 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.914259 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.914345 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.914575 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.914665 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.914910 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.914999 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.915219 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.915306 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.915533 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.915624 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.915851 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.915938 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.916167 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.916253 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.916481 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.916579 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.916803 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.916890 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.917114 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.917209 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.917431 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.917520 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.917743 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.917831 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.918055 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.918151 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.918372 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.918461 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.918628 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=87443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 12 14:38:28.918761 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.919028 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.919358 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.919682 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.920007 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.920354 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.920670 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.921014 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.921341 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:38:28.921585 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=87444) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 12 14:38:28.954205 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG oslo_db.sqlalchemy.engines [None req-42726834-5f49-45f4-bbf2-a813d62f5017 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87443) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} May 12 14:38:28.955312 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG oslo_db.sqlalchemy.engines [None req-280c76f8-6fb3-43e5-9044-59ea6f24542d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87444) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} May 12 14:38:29.194862 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.context [None req-280c76f8-6fb3-43e5-9044-59ea6f24542d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),da96a16e-7498-4758-9db5-c67f00079eae(cell1) {{(pid=87444) load_cells /opt/stack/nova/nova/context.py:464}} May 12 14:38:29.198357 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.context [None req-42726834-5f49-45f4-bbf2-a813d62f5017 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),da96a16e-7498-4758-9db5-c67f00079eae(cell1) {{(pid=87443) load_cells /opt/stack/nova/nova/context.py:464}} May 12 14:38:29.198853 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG oslo_concurrency.lockutils [None req-280c76f8-6fb3-43e5-9044-59ea6f24542d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:38:29.200493 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG oslo_concurrency.lockutils [None req-280c76f8-6fb3-43e5-9044-59ea6f24542d None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:38:29.201283 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG oslo_concurrency.lockutils [None req-280c76f8-6fb3-43e5-9044-59ea6f24542d None None] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:38:29.202521 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG oslo_concurrency.lockutils [None req-42726834-5f49-45f4-bbf2-a813d62f5017 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:38:29.203374 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG oslo_concurrency.lockutils [None req-280c76f8-6fb3-43e5-9044-59ea6f24542d None None] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:38:29.204312 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG oslo_concurrency.lockutils [None req-42726834-5f49-45f4-bbf2-a813d62f5017 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:38:29.205066 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG oslo_concurrency.lockutils [None req-42726834-5f49-45f4-bbf2-a813d62f5017 None None] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:38:29.207053 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG oslo_concurrency.lockutils [None req-42726834-5f49-45f4-bbf2-a813d62f5017 None None] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87443) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:38:29.228811 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG oslo_db.sqlalchemy.engines [None req-280c76f8-6fb3-43e5-9044-59ea6f24542d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87444) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} May 12 14:38:29.242526 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG oslo_db.sqlalchemy.engines [None req-42726834-5f49-45f4-bbf2-a813d62f5017 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87443) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} May 12 14:38:29.243479 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG oslo_db.sqlalchemy.engines [None req-42726834-5f49-45f4-bbf2-a813d62f5017 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87443) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} May 12 14:38:29.245112 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG oslo_db.sqlalchemy.engines [None req-280c76f8-6fb3-43e5-9044-59ea6f24542d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87444) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} May 12 14:38:29.271419 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG oslo_db.sqlalchemy.engines [None req-280c76f8-6fb3-43e5-9044-59ea6f24542d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87444) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} May 12 14:38:29.276909 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG oslo_db.sqlalchemy.engines [None req-42726834-5f49-45f4-bbf2-a813d62f5017 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87443) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} May 12 14:38:29.549613 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: INFO keyring.backend [None req-280c76f8-6fb3-43e5-9044-59ea6f24542d None None] Loading KWallet May 12 14:38:29.569410 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: INFO keyring.backend [None req-42726834-5f49-45f4-bbf2-a813d62f5017 None None] Loading KWallet May 12 14:38:29.651882 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: INFO keyring.backend [None req-280c76f8-6fb3-43e5-9044-59ea6f24542d None None] Loading SecretService May 12 14:38:29.655530 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 14:38:29.655530 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: from cryptography.utils import int_from_bytes May 12 14:38:29.655850 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 14:38:29.655850 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: from cryptography.utils import int_from_bytes May 12 14:38:29.656642 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: INFO keyring.backend [None req-280c76f8-6fb3-43e5-9044-59ea6f24542d None None] Loading Windows May 12 14:38:29.659109 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: INFO keyring.backend [None req-280c76f8-6fb3-43e5-9044-59ea6f24542d None None] Loading chainer May 12 14:38:29.659905 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: INFO keyring.backend [None req-280c76f8-6fb3-43e5-9044-59ea6f24542d None None] Loading macOS May 12 14:38:29.671945 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: INFO keyring.backend [None req-42726834-5f49-45f4-bbf2-a813d62f5017 None None] Loading SecretService May 12 14:38:29.675504 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 14:38:29.675504 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: from cryptography.utils import int_from_bytes May 12 14:38:29.676088 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 14:38:29.676088 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: from cryptography.utils import int_from_bytes May 12 14:38:29.676520 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: INFO keyring.backend [None req-42726834-5f49-45f4-bbf2-a813d62f5017 None None] Loading Windows May 12 14:38:29.678366 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: INFO keyring.backend [None req-42726834-5f49-45f4-bbf2-a813d62f5017 None None] Loading chainer May 12 14:38:29.679190 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: INFO keyring.backend [None req-42726834-5f49-45f4-bbf2-a813d62f5017 None None] Loading macOS May 12 14:38:29.911924 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: WARNING keystonemiddleware.auth_token [None req-280c76f8-6fb3-43e5-9044-59ea6f24542d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 12 14:38:29.918432 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: WARNING keystonemiddleware.auth_token [None req-280c76f8-6fb3-43e5-9044-59ea6f24542d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 12 14:38:29.926727 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: WARNING keystonemiddleware.auth_token [None req-42726834-5f49-45f4-bbf2-a813d62f5017 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 12 14:38:29.933293 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: WARNING keystonemiddleware.auth_token [None req-42726834-5f49-45f4-bbf2-a813d62f5017 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 12 14:38:30.129440 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: WARNING keystonemiddleware.auth_token [None req-280c76f8-6fb3-43e5-9044-59ea6f24542d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 12 14:38:30.134512 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: WARNING keystonemiddleware.auth_token [None req-280c76f8-6fb3-43e5-9044-59ea6f24542d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 12 14:38:30.140794 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55cbb07f09c0 pid: 87444 (default app) May 12 14:38:30.142895 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi [None req-280c76f8-6fb3-43e5-9044-59ea6f24542d None None] Calling method '>' {{(pid=87444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:38:30.143931 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: WARNING keystonemiddleware.auth_token [None req-42726834-5f49-45f4-bbf2-a813d62f5017 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 12 14:38:30.144111 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: INFO nova.api.openstack.requestlog [None req-280c76f8-6fb3-43e5-9044-59ea6f24542d None None] 10.222.0.49 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001635 May 12 14:38:30.144403 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: [pid: 87444|app: 0|req: 1/1] 10.222.0.49 () {50 vars in 788 bytes} [Thu May 12 14:38:30 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:38:30.149289 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: WARNING keystonemiddleware.auth_token [None req-42726834-5f49-45f4-bbf2-a813d62f5017 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 12 14:38:30.155525 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55cbb07f09c0 pid: 87443 (default app) May 12 14:39:53.658070 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi [None req-280c76f8-6fb3-43e5-9044-59ea6f24542d None None] Calling method '>' {{(pid=87444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:53.659128 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: INFO nova.api.openstack.requestlog [None req-280c76f8-6fb3-43e5-9044-59ea6f24542d None None] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001592 May 12 14:39:53.659529 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: [pid: 87444|app: 0|req: 2/2] 10.222.0.49 () {54 vars in 930 bytes} [Thu May 12 14:39:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:39:54.213316 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi [None req-2cb26fd0-770c-4d99-9088-1835efba1967 admin admin] Calling method '>' {{(pid=87443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:54.239062 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: INFO nova.api.openstack.requestlog [None req-2cb26fd0-770c-4d99-9088-1835efba1967 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.572545 May 12 14:39:54.239593 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: [pid: 87443|app: 0|req: 1/3] 10.222.0.49 () {60 vars in 1291 bytes} [Thu May 12 14:39:53 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:56.408426 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi [None req-280c76f8-6fb3-43e5-9044-59ea6f24542d None None] Calling method '>' {{(pid=87444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:56.409440 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: INFO nova.api.openstack.requestlog [None req-280c76f8-6fb3-43e5-9044-59ea6f24542d None None] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 May 12 14:39:56.409831 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: [pid: 87444|app: 0|req: 3/4] 10.222.0.49 () {54 vars in 930 bytes} [Thu May 12 14:39:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 14:39:56.480346 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi [None req-ce8f6c7c-c304-4afd-8cd2-b4075e8849f8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 1, "ram": 256, "id": "c1", "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=87443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:39:56.499433 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:39:56.499433 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: warnings.warn(msg) May 12 14:39:56.619659 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: INFO nova.api.openstack.requestlog [None req-ce8f6c7c-c304-4afd-8cd2-b4075e8849f8 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.203262 May 12 14:39:56.620228 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: [pid: 87443|app: 0|req: 2/5] 10.222.0.49 () {64 vars in 1282 bytes} [Thu May 12 14:39:56 2022] POST /compute/v2.1/flavors => generated 407 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 12 14:39:56.945813 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi [None req-1c1044bb-389f-4cfb-ac86-252d21b53def admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=87444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:39:56.948069 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:39:56.948069 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: warnings.warn(msg) May 12 14:39:57.037007 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: INFO nova.api.openstack.requestlog [None req-1c1044bb-389f-4cfb-ac86-252d21b53def admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.408185 May 12 14:39:57.037567 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: [pid: 87444|app: 0|req: 4/6] 10.222.0.49 () {64 vars in 1335 bytes} [Thu May 12 14:39:56 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:39:59.220616 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi [None req-ce8f6c7c-c304-4afd-8cd2-b4075e8849f8 admin admin] Calling method '>' {{(pid=87443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:39:59.221855 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: INFO nova.api.openstack.requestlog [None req-ce8f6c7c-c304-4afd-8cd2-b4075e8849f8 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001988 May 12 14:39:59.222445 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: [pid: 87443|app: 0|req: 3/7] 10.222.0.49 () {54 vars in 930 bytes} [Thu May 12 14:39:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:39:59.330870 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi [None req-eed61cfc-d9a2-4961-b6cb-5b4f5698ead5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "rxtx_factor": 1.0, "id": "d1", "ram": 512, "os-flavor-access:is_public": true, "name": "ds512M", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5}} {{(pid=87444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:39:59.348678 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:39:59.348678 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: warnings.warn(msg) May 12 14:39:59.466784 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: INFO nova.api.openstack.requestlog [None req-eed61cfc-d9a2-4961-b6cb-5b4f5698ead5 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.235923 May 12 14:39:59.467415 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: [pid: 87444|app: 0|req: 5/8] 10.222.0.49 () {64 vars in 1282 bytes} [Thu May 12 14:39:59 2022] POST /compute/v2.1/flavors => generated 404 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 14:39:59.479473 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi [None req-53058600-72a7-496f-86ef-20254ae08e55 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=87443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:39:59.480950 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:39:59.480950 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: warnings.warn(msg) May 12 14:39:59.608358 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: INFO nova.api.openstack.requestlog [None req-53058600-72a7-496f-86ef-20254ae08e55 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.132427 May 12 14:39:59.608945 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: [pid: 87443|app: 0|req: 4/9] 10.222.0.49 () {64 vars in 1335 bytes} [Thu May 12 14:39:59 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:40:01.775564 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi [None req-eed61cfc-d9a2-4961-b6cb-5b4f5698ead5 admin admin] Calling method '>' {{(pid=87444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:01.776557 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: INFO nova.api.openstack.requestlog [None req-eed61cfc-d9a2-4961-b6cb-5b4f5698ead5 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 May 12 14:40:01.776951 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: [pid: 87444|app: 0|req: 6/10] 10.222.0.49 () {54 vars in 930 bytes} [Thu May 12 14:40:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:40:01.832139 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi [None req-fef730e1-ef4b-42ad-997d-c2dc0a3e96fc admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "vcpus": 1, "disk": 10, "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "id": "d2", "name": "ds1G"}} {{(pid=87443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:40:01.968726 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: INFO nova.api.openstack.requestlog [None req-fef730e1-ef4b-42ad-997d-c2dc0a3e96fc admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.186067 May 12 14:40:01.969283 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: [pid: 87443|app: 0|req: 5/11] 10.222.0.49 () {64 vars in 1282 bytes} [Thu May 12 14:40:01 2022] POST /compute/v2.1/flavors => generated 404 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 14:40:01.981258 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi [None req-b9a7b077-4a8d-4702-9909-5b5967deb27f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=87444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:40:02.065626 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: INFO nova.api.openstack.requestlog [None req-b9a7b077-4a8d-4702-9909-5b5967deb27f admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.087986 May 12 14:40:02.066177 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: [pid: 87444|app: 0|req: 7/12] 10.222.0.49 () {64 vars in 1335 bytes} [Thu May 12 14:40:01 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:40:04.253184 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi [None req-fef730e1-ef4b-42ad-997d-c2dc0a3e96fc admin admin] Calling method '>' {{(pid=87443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:04.254185 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: INFO nova.api.openstack.requestlog [None req-fef730e1-ef4b-42ad-997d-c2dc0a3e96fc admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 May 12 14:40:04.254601 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: [pid: 87443|app: 0|req: 6/13] 10.222.0.49 () {54 vars in 930 bytes} [Thu May 12 14:40:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:40:04.309823 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi [None req-3a9e3292-7cc5-47f3-838f-a62cb02280d2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "rxtx_factor": 1.0, "name": "ds2G", "vcpus": 2, "os-flavor-access:is_public": true, "ram": 2048}} {{(pid=87444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:40:04.404713 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: INFO nova.api.openstack.requestlog [None req-3a9e3292-7cc5-47f3-838f-a62cb02280d2 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.143985 May 12 14:40:04.405240 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: [pid: 87444|app: 0|req: 8/14] 10.222.0.49 () {64 vars in 1282 bytes} [Thu May 12 14:40:04 2022] POST /compute/v2.1/flavors => generated 404 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 14:40:04.417119 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi [None req-a1cb007e-5b95-47e9-b6ee-139f0859a0a2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=87443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:40:04.523633 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: INFO nova.api.openstack.requestlog [None req-a1cb007e-5b95-47e9-b6ee-139f0859a0a2 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.110066 May 12 14:40:04.525302 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: [pid: 87443|app: 0|req: 7/15] 10.222.0.49 () {64 vars in 1335 bytes} [Thu May 12 14:40:04 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:40:06.692162 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi [None req-3a9e3292-7cc5-47f3-838f-a62cb02280d2 admin admin] Calling method '>' {{(pid=87444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:06.693146 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: INFO nova.api.openstack.requestlog [None req-3a9e3292-7cc5-47f3-838f-a62cb02280d2 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001398 May 12 14:40:06.693539 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: [pid: 87444|app: 0|req: 9/16] 10.222.0.49 () {54 vars in 930 bytes} [Thu May 12 14:40:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:40:06.749153 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi [None req-22446e55-517d-411a-8557-1d7d3ade3cf0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "name": "ds4G", "ram": 4096, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "id": "d4", "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=87443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:40:06.876412 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: INFO nova.api.openstack.requestlog [None req-22446e55-517d-411a-8557-1d7d3ade3cf0 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.176513 May 12 14:40:06.876840 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: [pid: 87443|app: 0|req: 8/17] 10.222.0.49 () {64 vars in 1282 bytes} [Thu May 12 14:40:06 2022] POST /compute/v2.1/flavors => generated 404 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 12 14:40:06.888222 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi [None req-12487ea3-7395-4984-8ab6-406679bd7ca6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=87444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:40:07.014271 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: INFO nova.api.openstack.requestlog [None req-12487ea3-7395-4984-8ab6-406679bd7ca6 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.129569 May 12 14:40:07.014851 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: [pid: 87444|app: 0|req: 10/18] 10.222.0.49 () {64 vars in 1335 bytes} [Thu May 12 14:40:06 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:40:09.203634 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi [None req-22446e55-517d-411a-8557-1d7d3ade3cf0 admin admin] Calling method '>' {{(pid=87443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:09.204628 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: INFO nova.api.openstack.requestlog [None req-22446e55-517d-411a-8557-1d7d3ade3cf0 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 May 12 14:40:09.205024 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: [pid: 87443|app: 0|req: 9/19] 10.222.0.49 () {54 vars in 930 bytes} [Thu May 12 14:40:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:40:09.278299 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi [None req-de82b674-3d5e-4b06-becf-7c0e99ea81a2 admin admin] Calling method '>' {{(pid=87444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:09.299988 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: INFO nova.api.openstack.requestlog [None req-de82b674-3d5e-4b06-becf-7c0e99ea81a2 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.087988 May 12 14:40:09.300522 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: [pid: 87444|app: 0|req: 11/20] 10.222.0.49 () {60 vars in 1291 bytes} [Thu May 12 14:40:09 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:40:11.523034 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi [None req-22446e55-517d-411a-8557-1d7d3ade3cf0 admin admin] Calling method '>' {{(pid=87443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:11.524027 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: INFO nova.api.openstack.requestlog [None req-22446e55-517d-411a-8557-1d7d3ade3cf0 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 May 12 14:40:11.524422 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: [pid: 87443|app: 0|req: 10/21] 10.222.0.49 () {54 vars in 930 bytes} [Thu May 12 14:40:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:40:11.578593 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi [None req-a557cc94-f26f-4fcc-ba93-64872d785b29 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 512, "rxtx_factor": 1.0, "vcpus": 1, "disk": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "name": "m1.tiny"}} {{(pid=87444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:40:11.669380 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: INFO nova.api.openstack.requestlog [None req-a557cc94-f26f-4fcc-ba93-64872d785b29 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.139253 May 12 14:40:11.669914 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: [pid: 87444|app: 0|req: 12/22] 10.222.0.49 () {64 vars in 1282 bytes} [Thu May 12 14:40:11 2022] POST /compute/v2.1/flavors => generated 402 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 14:40:11.682064 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi [None req-aa484eff-837b-4f45-9bcb-fb84e10e119e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=87443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:40:11.791617 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: INFO nova.api.openstack.requestlog [None req-aa484eff-837b-4f45-9bcb-fb84e10e119e admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.113084 May 12 14:40:11.792115 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: [pid: 87443|app: 0|req: 11/23] 10.222.0.49 () {64 vars in 1332 bytes} [Thu May 12 14:40:11 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:40:14.009943 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi [None req-a557cc94-f26f-4fcc-ba93-64872d785b29 admin admin] Calling method '>' {{(pid=87444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:14.011046 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: INFO nova.api.openstack.requestlog [None req-a557cc94-f26f-4fcc-ba93-64872d785b29 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001599 May 12 14:40:14.011458 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: [pid: 87444|app: 0|req: 13/24] 10.222.0.49 () {54 vars in 930 bytes} [Thu May 12 14:40:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:40:14.068541 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi [None req-302eaa7b-621c-4397-ac79-4a3fcd88424f admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "disk": 20, "swap": 0, "name": "m1.small", "rxtx_factor": 1.0, "vcpus": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048}} {{(pid=87443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:40:14.182445 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: INFO nova.api.openstack.requestlog [None req-302eaa7b-621c-4397-ac79-4a3fcd88424f admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.164058 May 12 14:40:14.182931 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: [pid: 87443|app: 0|req: 12/25] 10.222.0.49 () {64 vars in 1282 bytes} [Thu May 12 14:40:14 2022] POST /compute/v2.1/flavors => generated 405 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 14:40:14.194833 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi [None req-6470dd69-80ae-49c6-99b7-a13f6d07cc15 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=87444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:40:14.328389 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: INFO nova.api.openstack.requestlog [None req-6470dd69-80ae-49c6-99b7-a13f6d07cc15 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.137238 May 12 14:40:14.328996 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: [pid: 87444|app: 0|req: 14/26] 10.222.0.49 () {64 vars in 1332 bytes} [Thu May 12 14:40:14 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:40:16.515571 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi [None req-302eaa7b-621c-4397-ac79-4a3fcd88424f admin admin] Calling method '>' {{(pid=87443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:16.517165 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: INFO nova.api.openstack.requestlog [None req-302eaa7b-621c-4397-ac79-4a3fcd88424f admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002008 May 12 14:40:16.517542 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: [pid: 87443|app: 0|req: 13/27] 10.222.0.49 () {54 vars in 930 bytes} [Thu May 12 14:40:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:40:16.572687 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi [None req-bed2ed6f-b8fa-4abf-89ae-a118a7c2fc6d admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "swap": 0, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "vcpus": 2, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 40}} {{(pid=87444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:40:16.666528 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: INFO nova.api.openstack.requestlog [None req-bed2ed6f-b8fa-4abf-89ae-a118a7c2fc6d admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.142873 May 12 14:40:16.667100 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: [pid: 87444|app: 0|req: 15/28] 10.222.0.49 () {64 vars in 1282 bytes} [Thu May 12 14:40:16 2022] POST /compute/v2.1/flavors => generated 406 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 14:40:16.679121 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi [None req-4798ab4c-8385-46b6-a27b-e45948c22fe4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=87443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:40:16.762214 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: INFO nova.api.openstack.requestlog [None req-4798ab4c-8385-46b6-a27b-e45948c22fe4 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.086621 May 12 14:40:16.762684 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: [pid: 87443|app: 0|req: 14/29] 10.222.0.49 () {64 vars in 1332 bytes} [Thu May 12 14:40:16 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:40:18.926164 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi [None req-bed2ed6f-b8fa-4abf-89ae-a118a7c2fc6d admin admin] Calling method '>' {{(pid=87444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:18.927202 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: INFO nova.api.openstack.requestlog [None req-bed2ed6f-b8fa-4abf-89ae-a118a7c2fc6d admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001408 May 12 14:40:18.927597 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: [pid: 87444|app: 0|req: 16/30] 10.222.0.49 () {54 vars in 930 bytes} [Thu May 12 14:40:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:40:18.981897 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi [None req-6b5bc74a-4d3b-4b16-9392-4eed40ac3022 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 8192, "name": "m1.large", "swap": 0, "id": "4", "vcpus": 4}} {{(pid=87443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:40:19.105795 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: INFO nova.api.openstack.requestlog [None req-6b5bc74a-4d3b-4b16-9392-4eed40ac3022 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.172408 May 12 14:40:19.106330 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: [pid: 87443|app: 0|req: 15/31] 10.222.0.49 () {64 vars in 1282 bytes} [Thu May 12 14:40:18 2022] POST /compute/v2.1/flavors => generated 405 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 12 14:40:19.117707 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi [None req-d05a1286-a0d2-46f8-85a6-ad36f738a241 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=87444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:40:19.212292 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: INFO nova.api.openstack.requestlog [None req-d05a1286-a0d2-46f8-85a6-ad36f738a241 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.098185 May 12 14:40:19.212873 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: [pid: 87444|app: 0|req: 17/32] 10.222.0.49 () {64 vars in 1332 bytes} [Thu May 12 14:40:19 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:40:21.384008 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi [None req-6b5bc74a-4d3b-4b16-9392-4eed40ac3022 admin admin] Calling method '>' {{(pid=87443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:40:21.384993 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: INFO nova.api.openstack.requestlog [None req-6b5bc74a-4d3b-4b16-9392-4eed40ac3022 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 May 12 14:40:21.385379 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: [pid: 87443|app: 0|req: 16/33] 10.222.0.49 () {54 vars in 930 bytes} [Thu May 12 14:40:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:40:21.441489 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi [None req-fc558995-1f57-4fe9-9e7e-fcfb3be19b48 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 16384, "vcpus": 8, "name": "m1.xlarge", "disk": 160, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "5"}} {{(pid=87444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:40:21.559717 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: INFO nova.api.openstack.requestlog [None req-fc558995-1f57-4fe9-9e7e-fcfb3be19b48 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.168414 May 12 14:40:21.560251 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: [pid: 87444|app: 0|req: 18/34] 10.222.0.49 () {64 vars in 1282 bytes} [Thu May 12 14:40:21 2022] POST /compute/v2.1/flavors => generated 408 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 12 14:40:21.572588 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi [None req-032e2bd5-3f93-47c3-99f9-61ea26b4b998 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=87443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:40:21.653220 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: INFO nova.api.openstack.requestlog [None req-032e2bd5-3f93-47c3-99f9-61ea26b4b998 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.084195 May 12 14:40:21.653792 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: [pid: 87443|app: 0|req: 17/35] 10.222.0.49 () {64 vars in 1332 bytes} [Thu May 12 14:40:21 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:41:30.722913 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi [None req-fc558995-1f57-4fe9-9e7e-fcfb3be19b48 admin admin] Calling method '>' {{(pid=87444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:30.723909 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: INFO nova.api.openstack.requestlog [None req-fc558995-1f57-4fe9-9e7e-fcfb3be19b48 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 May 12 14:41:30.724323 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: [pid: 87444|app: 0|req: 19/36] 10.222.0.49 () {54 vars in 930 bytes} [Thu May 12 14:41:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:41:30.779218 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi [None req-6c30a2c9-2933-4763-b021-f9d8ad496c15 admin admin] Calling method '>' {{(pid=87443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:30.802426 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: INFO nova.api.openstack.requestlog [None req-6c30a2c9-2933-4763-b021-f9d8ad496c15 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.072312 May 12 14:41:30.802981 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: [pid: 87443|app: 0|req: 18/37] 10.222.0.49 () {60 vars in 1291 bytes} [Thu May 12 14:41:30 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:41:32.256928 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi [None req-fc558995-1f57-4fe9-9e7e-fcfb3be19b48 admin admin] Calling method '>' {{(pid=87444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:32.257925 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: INFO nova.api.openstack.requestlog [None req-fc558995-1f57-4fe9-9e7e-fcfb3be19b48 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001399 May 12 14:41:32.258608 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: [pid: 87444|app: 0|req: 20/38] 10.222.0.49 () {56 vars in 1074 bytes} [Thu May 12 14:41:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:41:32.442673 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi [None req-d96f451f-0345-405d-bf9f-48020061aef6 admin admin] Calling method '>' {{(pid=87443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:32.454570 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: INFO nova.api.openstack.wsgi [None req-d96f451f-0345-405d-bf9f-48020061aef6 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 12 14:41:32.455157 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi [None req-d96f451f-0345-405d-bf9f-48020061aef6 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=87443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 12 14:41:32.455939 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: INFO nova.api.openstack.requestlog [None req-d96f451f-0345-405d-bf9f-48020061aef6 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.062504 May 12 14:41:32.456439 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: [pid: 87443|app: 0|req: 19/39] 10.222.0.49 () {60 vars in 1190 bytes} [Thu May 12 14:41:32 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 12 14:41:32.465745 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi [None req-9327108b-95fe-406a-b5e4-c3c144bbd157 admin admin] Calling method '>' {{(pid=87444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:32.485684 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: INFO nova.api.openstack.requestlog [None req-9327108b-95fe-406a-b5e4-c3c144bbd157 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.023432 May 12 14:41:32.486196 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: [pid: 87444|app: 0|req: 21/40] 10.222.0.49 () {60 vars in 1210 bytes} [Thu May 12 14:41:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:41:32.495388 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi [None req-5513ec0c-eb1e-4dc7-8b61-5a062ff6bc07 admin admin] Calling method '>' {{(pid=87443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:32.515414 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: INFO nova.api.openstack.requestlog [None req-5513ec0c-eb1e-4dc7-8b61-5a062ff6bc07 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.023373 May 12 14:41:32.516449 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: [pid: 87443|app: 0|req: 20/41] 10.222.0.49 () {60 vars in 1210 bytes} [Thu May 12 14:41:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 14:41:32.525806 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi [None req-0361686f-ca2e-4b78-a834-20cae2e7296d admin admin] Calling method '>' {{(pid=87444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:32.538299 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: INFO nova.api.openstack.wsgi [None req-0361686f-ca2e-4b78-a834-20cae2e7296d admin admin] HTTP exception thrown: Flavor 42 could not be found. May 12 14:41:32.538898 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi [None req-0361686f-ca2e-4b78-a834-20cae2e7296d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=87444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 12 14:41:32.539679 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: INFO nova.api.openstack.requestlog [None req-0361686f-ca2e-4b78-a834-20cae2e7296d admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.017602 May 12 14:41:32.540162 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: [pid: 87444|app: 0|req: 22/42] 10.222.0.49 () {60 vars in 1190 bytes} [Thu May 12 14:41:32 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 12 14:41:33.898435 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi [None req-5513ec0c-eb1e-4dc7-8b61-5a062ff6bc07 admin admin] Calling method '>' {{(pid=87443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:33.899587 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: INFO nova.api.openstack.requestlog [None req-5513ec0c-eb1e-4dc7-8b61-5a062ff6bc07 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001553 May 12 14:41:33.900090 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: [pid: 87443|app: 0|req: 21/43] 10.222.0.49 () {56 vars in 1074 bytes} [Thu May 12 14:41:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:41:34.087326 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi [None req-1fc3b60f-6d4f-499a-b09b-8f36999e78af admin admin] Calling method '>' {{(pid=87444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:34.099380 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: INFO nova.api.openstack.wsgi [None req-1fc3b60f-6d4f-499a-b09b-8f36999e78af admin admin] HTTP exception thrown: Flavor 84 could not be found. May 12 14:41:34.099881 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi [None req-1fc3b60f-6d4f-499a-b09b-8f36999e78af admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=87444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 12 14:41:34.100671 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: INFO nova.api.openstack.requestlog [None req-1fc3b60f-6d4f-499a-b09b-8f36999e78af admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.063094 May 12 14:41:34.101156 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: [pid: 87444|app: 0|req: 23/44] 10.222.0.49 () {60 vars in 1190 bytes} [Thu May 12 14:41:34 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 12 14:41:34.111169 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi [None req-6ddc4040-8e94-437a-8cc6-eee2a727549a admin admin] Calling method '>' {{(pid=87443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:34.131173 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: INFO nova.api.openstack.requestlog [None req-6ddc4040-8e94-437a-8cc6-eee2a727549a admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.024137 May 12 14:41:34.131700 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: [pid: 87443|app: 0|req: 22/45] 10.222.0.49 () {60 vars in 1210 bytes} [Thu May 12 14:41:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:41:34.140765 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi [None req-f7cbcf15-66a5-4e6e-86a7-cd925c04d21c admin admin] Calling method '>' {{(pid=87444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:34.160993 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: INFO nova.api.openstack.requestlog [None req-f7cbcf15-66a5-4e6e-86a7-cd925c04d21c admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.023575 May 12 14:41:34.161702 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: [pid: 87444|app: 0|req: 24/46] 10.222.0.49 () {60 vars in 1210 bytes} [Thu May 12 14:41:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:41:34.170749 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi [None req-78f0fe4d-3530-44f4-96fb-c31d0d077b43 admin admin] Calling method '>' {{(pid=87443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:34.183062 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: INFO nova.api.openstack.wsgi [None req-78f0fe4d-3530-44f4-96fb-c31d0d077b43 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 12 14:41:34.183618 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi [None req-78f0fe4d-3530-44f4-96fb-c31d0d077b43 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=87443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 12 14:41:34.184382 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: INFO nova.api.openstack.requestlog [None req-78f0fe4d-3530-44f4-96fb-c31d0d077b43 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.017047 May 12 14:41:34.184872 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: [pid: 87443|app: 0|req: 23/47] 10.222.0.49 () {60 vars in 1190 bytes} [Thu May 12 14:41:34 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 12 14:41:35.540618 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi [None req-f7cbcf15-66a5-4e6e-86a7-cd925c04d21c admin admin] Calling method '>' {{(pid=87444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:35.541639 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: INFO nova.api.openstack.requestlog [None req-f7cbcf15-66a5-4e6e-86a7-cd925c04d21c admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 May 12 14:41:35.542036 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: [pid: 87444|app: 0|req: 25/48] 10.222.0.49 () {56 vars in 1074 bytes} [Thu May 12 14:41:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:41:35.730194 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi [None req-a7c9c405-20a0-4cad-9b9c-8906122a294d admin admin] Calling method '>' {{(pid=87443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:35.742677 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: INFO nova.api.openstack.wsgi [None req-a7c9c405-20a0-4cad-9b9c-8906122a294d admin admin] HTTP exception thrown: Flavor 451 could not be found. May 12 14:41:35.743270 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi [None req-a7c9c405-20a0-4cad-9b9c-8906122a294d admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=87443) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 12 14:41:35.744042 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: INFO nova.api.openstack.requestlog [None req-a7c9c405-20a0-4cad-9b9c-8906122a294d admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.062763 May 12 14:41:35.744544 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: [pid: 87443|app: 0|req: 24/49] 10.222.0.49 () {60 vars in 1193 bytes} [Thu May 12 14:41:35 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 12 14:41:35.753891 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi [None req-044f3c17-c952-4e3a-8c99-b4563df0be5e admin admin] Calling method '>' {{(pid=87444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:35.773857 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: INFO nova.api.openstack.requestlog [None req-044f3c17-c952-4e3a-8c99-b4563df0be5e admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.023561 May 12 14:41:35.774382 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: [pid: 87444|app: 0|req: 26/50] 10.222.0.49 () {60 vars in 1210 bytes} [Thu May 12 14:41:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:41:35.783892 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi [None req-a2b9b85a-9151-4ed7-a99b-9ddb19e72602 admin admin] Calling method '>' {{(pid=87443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:35.803822 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: INFO nova.api.openstack.requestlog [None req-a2b9b85a-9151-4ed7-a99b-9ddb19e72602 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.023823 May 12 14:41:35.804337 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: [pid: 87443|app: 0|req: 25/51] 10.222.0.49 () {60 vars in 1210 bytes} [Thu May 12 14:41:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:41:35.813295 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi [None req-389bb868-2da5-499a-93f4-202dfefb50eb admin admin] Calling method '>' {{(pid=87444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:35.825140 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: INFO nova.api.openstack.wsgi [None req-389bb868-2da5-499a-93f4-202dfefb50eb admin admin] HTTP exception thrown: Flavor 451 could not be found. May 12 14:41:35.825703 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi [None req-389bb868-2da5-499a-93f4-202dfefb50eb admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=87444) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 12 14:41:35.826472 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: INFO nova.api.openstack.requestlog [None req-389bb868-2da5-499a-93f4-202dfefb50eb admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.016667 May 12 14:41:35.826990 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: [pid: 87444|app: 0|req: 27/52] 10.222.0.49 () {60 vars in 1193 bytes} [Thu May 12 14:41:35 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 12 14:41:37.195524 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi [None req-a2b9b85a-9151-4ed7-a99b-9ddb19e72602 admin admin] Calling method '>' {{(pid=87443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:37.196604 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: INFO nova.api.openstack.requestlog [None req-a2b9b85a-9151-4ed7-a99b-9ddb19e72602 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001539 May 12 14:41:37.197068 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: [pid: 87443|app: 0|req: 26/53] 10.222.0.49 () {56 vars in 1074 bytes} [Thu May 12 14:41:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:41:37.382368 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi [None req-f7db090a-a526-4d48-a8d8-f4fb4ab91b06 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=87444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:41:37.484101 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: INFO nova.api.openstack.requestlog [None req-f7db090a-a526-4d48-a8d8-f4fb4ab91b06 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.88 time: 0.151083 May 12 14:41:37.484671 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: [pid: 87444|app: 0|req: 28/54] 10.222.0.49 () {64 vars in 1235 bytes} [Thu May 12 14:41:37 2022] POST /compute/v2.1/flavors => generated 404 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 14:41:38.853025 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi [None req-a2b9b85a-9151-4ed7-a99b-9ddb19e72602 admin admin] Calling method '>' {{(pid=87443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:38.854002 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: INFO nova.api.openstack.requestlog [None req-a2b9b85a-9151-4ed7-a99b-9ddb19e72602 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001393 May 12 14:41:38.854403 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: [pid: 87443|app: 0|req: 27/55] 10.222.0.49 () {56 vars in 1074 bytes} [Thu May 12 14:41:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:41:39.039085 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi [None req-733d8ffa-8267-4c87-8a15-52cee9763957 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=87444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:41:39.119227 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: INFO nova.api.openstack.requestlog [None req-733d8ffa-8267-4c87-8a15-52cee9763957 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.88 time: 0.129826 May 12 14:41:39.119677 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: [pid: 87444|app: 0|req: 29/56] 10.222.0.49 () {64 vars in 1235 bytes} [Thu May 12 14:41:38 2022] POST /compute/v2.1/flavors => generated 405 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 14:41:40.486661 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi [None req-a2b9b85a-9151-4ed7-a99b-9ddb19e72602 admin admin] Calling method '>' {{(pid=87443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:40.487679 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: INFO nova.api.openstack.requestlog [None req-a2b9b85a-9151-4ed7-a99b-9ddb19e72602 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 May 12 14:41:40.488082 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: [pid: 87443|app: 0|req: 28/57] 10.222.0.49 () {56 vars in 1074 bytes} [Thu May 12 14:41:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 14:41:40.672929 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi [None req-470270ec-6190-4c9c-b59f-748a21828ced admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=87444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:41:40.791226 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: INFO nova.api.openstack.requestlog [None req-470270ec-6190-4c9c-b59f-748a21828ced admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.88 time: 0.167606 May 12 14:41:40.791692 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: [pid: 87444|app: 0|req: 30/58] 10.222.0.49 () {64 vars in 1235 bytes} [Thu May 12 14:41:40 2022] POST /compute/v2.1/flavors => generated 407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 14:41:42.164506 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi [None req-a2b9b85a-9151-4ed7-a99b-9ddb19e72602 admin admin] Calling method '>' {{(pid=87443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:42.165495 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: INFO nova.api.openstack.requestlog [None req-a2b9b85a-9151-4ed7-a99b-9ddb19e72602 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001397 May 12 14:41:42.166028 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: [pid: 87443|app: 0|req: 29/59] 10.222.0.49 () {56 vars in 1074 bytes} [Thu May 12 14:41:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:41:42.352076 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi [None req-0c9538eb-08d5-4258-b6ed-89fe26c0713b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=87444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:41:42.442216 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: INFO nova.api.openstack.requestlog [None req-0c9538eb-08d5-4258-b6ed-89fe26c0713b admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.88 time: 0.139126 May 12 14:41:42.442671 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: [pid: 87444|app: 0|req: 31/60] 10.222.0.49 () {64 vars in 1235 bytes} [Thu May 12 14:41:42 2022] POST /compute/v2.1/flavors => generated 409 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 14:41:43.807647 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi [None req-a2b9b85a-9151-4ed7-a99b-9ddb19e72602 admin admin] Calling method '>' {{(pid=87443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:43.808628 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: INFO nova.api.openstack.requestlog [None req-a2b9b85a-9151-4ed7-a99b-9ddb19e72602 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 May 12 14:41:43.809023 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: [pid: 87443|app: 0|req: 30/61] 10.222.0.49 () {56 vars in 1074 bytes} [Thu May 12 14:41:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:41:43.993921 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi [None req-87c5d3b8-6bbe-4e6e-8082-c37b1559db04 admin admin] Calling method '>' {{(pid=87444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:41:44.019760 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: INFO nova.api.openstack.requestlog [None req-87c5d3b8-6bbe-4e6e-8082-c37b1559db04 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.88 time: 0.075389 May 12 14:41:44.020225 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: [pid: 87444|app: 0|req: 32/62] 10.222.0.49 () {60 vars in 1202 bytes} [Thu May 12 14:41:43 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:42:24.958643 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi [None req-a2b9b85a-9151-4ed7-a99b-9ddb19e72602 admin admin] Calling method '>' {{(pid=87443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:24.959663 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: INFO nova.api.openstack.requestlog [None req-a2b9b85a-9151-4ed7-a99b-9ddb19e72602 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 May 12 14:42:24.960058 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: [pid: 87443|app: 0|req: 31/63] 10.222.0.49 () {56 vars in 1074 bytes} [Thu May 12 14:42:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:42:25.144901 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi [None req-9937fef0-84ac-4f89-9511-97dffc5611bd admin admin] Calling method '>' {{(pid=87444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:42:25.170531 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: INFO nova.api.openstack.requestlog [None req-9937fef0-84ac-4f89-9511-97dffc5611bd admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.88 time: 0.073524 May 12 14:42:25.171027 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: [pid: 87444|app: 0|req: 33/64] 10.222.0.49 () {60 vars in 1202 bytes} [Thu May 12 14:42:25 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:45:54.279557 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi [None req-a2b9b85a-9151-4ed7-a99b-9ddb19e72602 admin admin] Calling method '>' {{(pid=87443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:45:54.280538 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: INFO nova.api.openstack.requestlog [None req-a2b9b85a-9151-4ed7-a99b-9ddb19e72602 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001914 May 12 14:45:54.280932 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: [pid: 87443|app: 0|req: 32/65] 10.222.0.49 () {56 vars in 1074 bytes} [Thu May 12 14:45:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:45:54.549345 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi [None req-ecbdeacc-b319-4695-8885-4f3c125b391b admin admin] Calling method '>' {{(pid=87444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:45:54.550540 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:45:54.550540 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: warnings.warn(msg) May 12 14:45:54.552112 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG oslo_concurrency.lockutils [None req-ecbdeacc-b319-4695-8885-4f3c125b391b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:45:54.552600 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG oslo_concurrency.lockutils [None req-ecbdeacc-b319-4695-8885-4f3c125b391b admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:45:54.553438 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG oslo_concurrency.lockutils [None req-ecbdeacc-b319-4695-8885-4f3c125b391b admin admin] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:45:54.554132 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG oslo_concurrency.lockutils [None req-ecbdeacc-b319-4695-8885-4f3c125b391b admin admin] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:45:54.584603 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: INFO nova.api.openstack.requestlog [None req-ecbdeacc-b319-4695-8885-4f3c125b391b admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.88 time: 0.165163 May 12 14:45:54.585152 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: [pid: 87444|app: 0|req: 34/66] 10.222.0.49 () {60 vars in 1193 bytes} [Thu May 12 14:45:54 2022] GET /compute/v2.1/os-services => generated 791 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 14:45:55.949796 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi [None req-a2b9b85a-9151-4ed7-a99b-9ddb19e72602 admin admin] Calling method '>' {{(pid=87443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:45:55.950823 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: INFO nova.api.openstack.requestlog [None req-a2b9b85a-9151-4ed7-a99b-9ddb19e72602 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001410 May 12 14:45:55.951231 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: [pid: 87443|app: 0|req: 33/67] 10.222.0.49 () {56 vars in 1074 bytes} [Thu May 12 14:45:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:45:56.137176 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi [None req-c5c2cecd-52b3-4be8-a08d-971ae22d27f3 admin admin] Calling method '>' {{(pid=87444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:45:56.138357 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:45:56.138357 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: warnings.warn(msg) May 12 14:45:56.140008 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG oslo_concurrency.lockutils [None req-c5c2cecd-52b3-4be8-a08d-971ae22d27f3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:45:56.140452 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG oslo_concurrency.lockutils [None req-c5c2cecd-52b3-4be8-a08d-971ae22d27f3 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:45:56.141234 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG oslo_concurrency.lockutils [None req-c5c2cecd-52b3-4be8-a08d-971ae22d27f3 admin admin] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:45:56.141667 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG oslo_concurrency.lockutils [None req-c5c2cecd-52b3-4be8-a08d-971ae22d27f3 admin admin] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:45:56.164201 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: INFO nova.api.openstack.requestlog [None req-c5c2cecd-52b3-4be8-a08d-971ae22d27f3 admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.88 time: 0.077843 May 12 14:45:56.164674 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: [pid: 87444|app: 0|req: 35/68] 10.222.0.49 () {60 vars in 1193 bytes} [Thu May 12 14:45:56 2022] GET /compute/v2.1/os-services => generated 791 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 14:46:07.981519 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi [None req-a2b9b85a-9151-4ed7-a99b-9ddb19e72602 admin admin] Calling method '>' {{(pid=87443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:46:07.983084 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: INFO nova.api.openstack.requestlog [None req-a2b9b85a-9151-4ed7-a99b-9ddb19e72602 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001925 May 12 14:46:07.983489 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: [pid: 87443|app: 0|req: 34/69] 10.222.0.49 () {56 vars in 1074 bytes} [Thu May 12 14:46:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:46:08.173228 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi [None req-440f106d-c3b4-41f8-aad0-ab014d49e09d admin admin] Calling method '>' {{(pid=87444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:46:08.174378 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:46:08.174378 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: warnings.warn(msg) May 12 14:46:08.175891 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG oslo_concurrency.lockutils [None req-440f106d-c3b4-41f8-aad0-ab014d49e09d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:46:08.176326 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG oslo_concurrency.lockutils [None req-440f106d-c3b4-41f8-aad0-ab014d49e09d admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:46:08.177101 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG oslo_concurrency.lockutils [None req-440f106d-c3b4-41f8-aad0-ab014d49e09d admin admin] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:46:08.177525 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG oslo_concurrency.lockutils [None req-440f106d-c3b4-41f8-aad0-ab014d49e09d admin admin] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:46:08.205675 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: INFO nova.api.openstack.requestlog [None req-440f106d-c3b4-41f8-aad0-ab014d49e09d admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.88 time: 0.082503 May 12 14:46:08.206160 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: [pid: 87444|app: 0|req: 36/70] 10.222.0.49 () {60 vars in 1193 bytes} [Thu May 12 14:46:08 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:46:09.590058 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: DEBUG nova.api.openstack.wsgi [None req-a2b9b85a-9151-4ed7-a99b-9ddb19e72602 admin admin] Calling method '>' {{(pid=87443) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:46:09.591081 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: INFO nova.api.openstack.requestlog [None req-a2b9b85a-9151-4ed7-a99b-9ddb19e72602 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001390 May 12 14:46:09.592037 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: [pid: 87443|app: 0|req: 35/71] 10.222.0.49 () {56 vars in 1074 bytes} [Thu May 12 14:46:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:46:09.775680 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG nova.api.openstack.wsgi [None req-2f466430-8296-4537-889a-58dd18cf2e9b admin admin] Calling method '>' {{(pid=87444) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:46:09.776843 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:46:09.776843 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: warnings.warn(msg) May 12 14:46:09.778627 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG oslo_concurrency.lockutils [None req-2f466430-8296-4537-889a-58dd18cf2e9b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:46:09.779094 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG oslo_concurrency.lockutils [None req-2f466430-8296-4537-889a-58dd18cf2e9b admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:46:09.779889 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG oslo_concurrency.lockutils [None req-2f466430-8296-4537-889a-58dd18cf2e9b admin admin] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:46:09.780346 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: DEBUG oslo_concurrency.lockutils [None req-2f466430-8296-4537-889a-58dd18cf2e9b admin admin] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87444) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:46:09.805323 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: INFO nova.api.openstack.requestlog [None req-2f466430-8296-4537-889a-58dd18cf2e9b admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.88 time: 0.078830 May 12 14:46:09.805864 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: [pid: 87444|app: 0|req: 37/72] 10.222.0.49 () {60 vars in 1193 bytes} [Thu May 12 14:46:09 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:47:05.754753 dv-cinder-831187-2-iscsi devstack@n-api.service[87442]: Thu May 12 14:47:05 2022 - graceful shutdown triggered... May 12 14:47:05.754509 dv-cinder-831187-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 12 14:47:05.755714 dv-cinder-831187-2-iscsi devstack@n-api.service[87443]: Gracefully killing worker 1 (pid: 87443)... May 12 14:47:05.756268 dv-cinder-831187-2-iscsi devstack@n-api.service[87444]: Gracefully killing worker 2 (pid: 87444)... May 12 14:47:06.755546 dv-cinder-831187-2-iscsi devstack@n-api.service[87442]: worker 1 buried after 1 seconds May 12 14:47:06.756077 dv-cinder-831187-2-iscsi devstack@n-api.service[87442]: worker 2 buried after 1 seconds May 12 14:47:06.756077 dv-cinder-831187-2-iscsi devstack@n-api.service[87442]: goodbye to uWSGI. May 12 14:47:06.757007 dv-cinder-831187-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 12 14:47:06.757571 dv-cinder-831187-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 12 14:47:06.760426 dv-cinder-831187-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 12 14:47:06.769937 dv-cinder-831187-2-iscsi devstack@n-api.service[102194]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 12 14:47:06.771928 dv-cinder-831187-2-iscsi devstack@n-api.service[102194]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 12 14:47:06 2022] *** May 12 14:47:06.771928 dv-cinder-831187-2-iscsi devstack@n-api.service[102194]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 12 14:47:06.771928 dv-cinder-831187-2-iscsi devstack@n-api.service[102194]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 12 14:47:06.771928 dv-cinder-831187-2-iscsi devstack@n-api.service[102194]: nodename: dv-cinder-831187-2-iscsi May 12 14:47:06.771928 dv-cinder-831187-2-iscsi devstack@n-api.service[102194]: machine: x86_64 May 12 14:47:06.771928 dv-cinder-831187-2-iscsi devstack@n-api.service[102194]: clock source: unix May 12 14:47:06.771928 dv-cinder-831187-2-iscsi devstack@n-api.service[102194]: pcre jit disabled May 12 14:47:06.771928 dv-cinder-831187-2-iscsi devstack@n-api.service[102194]: detected number of CPU cores: 4 May 12 14:47:06.771928 dv-cinder-831187-2-iscsi devstack@n-api.service[102194]: current working directory: / May 12 14:47:06.771928 dv-cinder-831187-2-iscsi devstack@n-api.service[102194]: detected binary path: /usr/bin/uwsgi-core May 12 14:47:06.771928 dv-cinder-831187-2-iscsi devstack@n-api.service[102194]: your processes number limit is 47680 May 12 14:47:06.772730 dv-cinder-831187-2-iscsi devstack@n-api.service[102194]: your memory page size is 4096 bytes May 12 14:47:06.772730 dv-cinder-831187-2-iscsi devstack@n-api.service[102194]: detected max file descriptor number: 2048 May 12 14:47:06.772730 dv-cinder-831187-2-iscsi devstack@n-api.service[102194]: lock engine: pthread robust mutexes May 12 14:47:06.772730 dv-cinder-831187-2-iscsi devstack@n-api.service[102194]: thunder lock: enabled May 12 14:47:06.772730 dv-cinder-831187-2-iscsi devstack@n-api.service[102194]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 12 14:47:06.772730 dv-cinder-831187-2-iscsi devstack@n-api.service[102194]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 12 14:47:06.819126 dv-cinder-831187-2-iscsi devstack@n-api.service[102194]: Python main interpreter initialized at 0x55d6dfb2e9c0 May 12 14:47:06.819126 dv-cinder-831187-2-iscsi devstack@n-api.service[102194]: python threads support enabled May 12 14:47:06.819126 dv-cinder-831187-2-iscsi devstack@n-api.service[102194]: your server socket listen backlog is limited to 100 connections May 12 14:47:06.819126 dv-cinder-831187-2-iscsi devstack@n-api.service[102194]: your mercy for graceful operations on workers is 90 seconds May 12 14:47:06.819591 dv-cinder-831187-2-iscsi devstack@n-api.service[102194]: mapped 403077 bytes (393 KB) for 2 cores May 12 14:47:06.819591 dv-cinder-831187-2-iscsi devstack@n-api.service[102194]: *** Operational MODE: preforking *** May 12 14:47:06.819854 dv-cinder-831187-2-iscsi devstack@n-api.service[102194]: *** uWSGI is running in multiple interpreter mode *** May 12 14:47:06.819854 dv-cinder-831187-2-iscsi devstack@n-api.service[102194]: spawned uWSGI master process (pid: 102194) May 12 14:47:06.820063 dv-cinder-831187-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 12 14:47:06.820750 dv-cinder-831187-2-iscsi devstack@n-api.service[102194]: spawned uWSGI worker 1 (pid: 102212, cores: 1) May 12 14:47:06.823679 dv-cinder-831187-2-iscsi devstack@n-api.service[102194]: spawned uWSGI worker 2 (pid: 102213, cores: 1) May 12 14:47:06.823679 dv-cinder-831187-2-iscsi devstack@n-api.service[102194]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 12 14:47:10.904688 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 12 14:47:10.905416 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 12 14:47:10.905416 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 12 14:47:10.905763 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 12 14:47:10.906021 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 12 14:47:10.906412 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.906741 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.907097 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.907419 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.907752 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.908070 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.908389 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.908712 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.909045 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.909308 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.909626 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.909954 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-831187-2-iscsi {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.910279 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.910594 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.910932 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.911256 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.911565 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.911889 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.912200 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.912704 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.914202 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.914202 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.914202 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.914202 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.915086 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.915086 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.915086 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.915703 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.915703 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.918644 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.918644 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-831187-2-iscsi {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.918644 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.918644 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.918644 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.918644 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.918644 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.919471 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.919471 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.919471 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.919783 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.919963 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.920286 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.920610 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.920938 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.921245 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.921557 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.921872 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.922202 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.922514 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.922845 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.923099 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.923409 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.923736 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.924062 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.924392 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.924650 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.924904 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.925229 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.925555 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.925867 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.926177 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.926486 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.926797 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.927130 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.927444 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.927750 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.928059 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.928383 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.928699 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.929025 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.929336 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.929658 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.930056 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.930311 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.930621 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.930987 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.931314 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.931625 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.931951 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.932274 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.932584 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.932892 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.933201 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.933525 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.934400 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.934710 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.934988 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.935296 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.935605 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.935927 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.936234 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.936541 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.936848 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.937150 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.937462 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.937771 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.938075 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.938384 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.938703 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.939028 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.939336 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.939644 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.939951 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.940267 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.940775 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.940940 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.941193 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.941506 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.941814 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.942139 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.942450 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.942758 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.943111 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.943419 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.943729 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.944052 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.944365 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.946845 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.946845 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.946845 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.946845 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.946845 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.946845 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.946845 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.946845 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.947430 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.947430 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.947750 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.947987 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.948297 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.948603 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.948923 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.949280 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.949593 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.949903 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.950214 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.950543 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.950908 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.951248 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.951611 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.951911 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.952246 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.952583 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.952908 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.953228 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.953543 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.953875 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.954191 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.954513 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.954852 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.955178 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.955499 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.955833 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.956155 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.956477 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.956799 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.957114 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.957434 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.957765 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.958096 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.958414 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.958759 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.959134 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.959454 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.959783 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.960113 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.960431 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.960749 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.961061 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.961387 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.961709 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.962029 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.962349 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.962668 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.963025 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.963327 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.963636 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.963953 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.964294 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.964620 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.964971 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.965292 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.965611 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.965927 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.966242 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.966557 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.966889 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.967202 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.967513 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.967826 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.968138 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.968491 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.968793 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.969103 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.969454 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.969755 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.970027 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 12 14:47:10.970553 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.970736 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 12 14:47:10.970938 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.970938 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.971233 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 12 14:47:10.971382 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.971538 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 12 14:47:10.971680 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.971828 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 12 14:47:10.972064 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.972284 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.972438 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.972579 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.972718 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.972886 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.973035 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.973176 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.973664 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.973830 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.973973 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.974124 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.974272 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.974415 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.974562 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.974710 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.974877 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.975122 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.975299 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.975511 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.975667 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.975814 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.975968 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.976111 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-831187-2-iscsi {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.976251 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.976399 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.976552 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.976701 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.976858 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.976999 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.977151 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.977291 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.977437 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.977587 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.977737 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.977886 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.978033 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.978187 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.978331 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.978331 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.978874 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.979128 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.979282 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.979424 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.979572 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.979731 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.979974 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.980130 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.980321 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.980975 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.981130 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.981280 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.981422 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.981562 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.981727 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.981869 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.982044 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.982279 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.982500 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.982645 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.982795 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.982989 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.983140 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-831187-2-iscsi {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.983282 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.983429 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.983570 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.983838 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.984000 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.984153 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.984302 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.984302 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.984578 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.984727 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.984883 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.985024 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.985242 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.985396 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.985557 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.985779 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.985936 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.986085 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.986226 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.986366 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.986505 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.986653 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.986800 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.986969 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.987124 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.987265 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.987411 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.987561 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.987701 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.987852 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.988000 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.988158 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.988304 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.988452 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.988670 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.988894 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.989041 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.990094 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.990348 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.990504 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.990646 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.990804 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.991087 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.991249 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.991404 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.991546 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.991685 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.991825 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.991963 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.991963 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.992290 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.992530 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.992742 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.992907 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.993060 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.993209 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.993360 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.993512 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.993653 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.993803 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.994050 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.994198 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.994350 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.994505 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.994646 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.994785 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.994991 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.995135 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.995371 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.995527 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.995676 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.995901 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.996047 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.996228 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.996888 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.997031 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.997171 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.997318 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.997468 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.997620 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.997769 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.997917 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.998066 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.998066 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.998342 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.998342 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.998624 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.998877 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.999274 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.999274 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.999656 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:10.999815 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:10.999967 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:11.000108 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.000255 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:11.000493 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.000649 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:11.000805 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.000953 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:11.001100 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.001242 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:11.001381 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.001528 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:11.001678 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.001838 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:11.001987 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.002128 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:11.002268 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.002416 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:11.002637 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.002876 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:11.002876 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:11.003166 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.003166 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.003446 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:11.003669 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.003813 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:11.003964 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.004205 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:11.004352 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.004502 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:11.004643 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.004792 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:11.004932 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.005071 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:11.005218 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.005386 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:11.005601 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.005755 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:11.006116 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.006320 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:11.006320 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:11.006624 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.006779 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:11.006998 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.007155 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:11.007302 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.007462 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:11.007610 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.007765 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:11.007913 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.008065 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:11.008213 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.008457 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:11.008608 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.008761 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:11.008761 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:11.009142 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.009389 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:11.009633 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.009795 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:11.009951 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.010100 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:11.010254 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.010409 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:11.010674 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.010848 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:11.011013 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.011162 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:11.011321 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.011486 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:11.011635 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.011797 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:11.012449 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.012622 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:11.012963 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.013188 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:11.013344 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.013518 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:11.013676 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.013824 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:11.013978 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.014134 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:11.014383 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.014546 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:11.014695 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.014860 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:11.015015 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.015173 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:11.015322 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.015477 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:11.015729 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.015890 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:11.016038 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.016269 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:11.016431 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.016594 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:11.016742 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.016889 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:11.017035 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.017182 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:11.017342 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.017491 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:11.017638 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.017803 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:11.017959 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.018114 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:11.018275 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.018424 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:11.018571 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.018724 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:11.018937 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.019168 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:11.019329 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.019565 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:11.019798 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.019959 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:11.020124 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.020271 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:11.020426 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.020584 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 12 14:47:11.020831 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.020992 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.021142 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.021314 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.021471 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.021620 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.021777 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.021931 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.022098 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.022259 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.022417 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.022565 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.022713 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.022713 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.023093 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.023333 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.023496 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.023656 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.023813 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.023970 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.024126 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.024337 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.024591 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.024755 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.024913 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.025069 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.025223 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.025372 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.025525 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.025673 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.025917 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.026078 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.026226 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.026477 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.026638 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.026795 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.027012 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.027162 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.027307 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.028253 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.028416 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.028574 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.028733 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.028888 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.029039 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.029204 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.029430 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.029609 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.029842 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.030069 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.030232 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.030642 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.030642 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.031063 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.031218 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.031373 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.031530 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.031685 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.031834 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.032007 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.032165 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.032320 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.032474 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.032631 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.032793 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.032941 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.033107 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.033429 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.033595 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.033753 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.033917 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.034066 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.034224 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.034371 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.034525 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.034780 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.034969 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.035119 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.035268 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.035472 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.035624 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.035771 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.036017 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.036237 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.036410 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.036654 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.036817 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.036981 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.037129 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.037277 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.037438 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.037594 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.037742 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.038008 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.038161 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.038161 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.038443 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.038443 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.038750 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.038750 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.039115 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.039115 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.039433 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.039651 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.039823 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.040068 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.040300 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.040461 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.040617 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.040771 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.040930 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.041104 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.041337 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.041490 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.041638 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.041638 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.041997 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.042175 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.042325 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.042473 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.042621 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.042779 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.042970 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.043168 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.043336 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.043626 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.043789 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.044074 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.044239 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.044388 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.044543 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.044693 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.044848 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.045015 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.045258 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.045412 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.045578 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.045728 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.045875 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.046030 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.046179 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.046417 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.046572 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.046856 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.047016 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.047178 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.047342 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.047497 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.047657 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.047814 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.047969 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.048132 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.048390 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.048573 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.048736 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.048907 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.049065 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.049231 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.049380 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.049535 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.049780 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.049950 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.050200 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.050507 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.050662 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.050828 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.050996 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.051161 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.051380 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.051626 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.051788 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.051941 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.052091 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.052244 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.052414 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.052629 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.052786 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.052934 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.053082 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.053230 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.053391 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.053710 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.053871 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.054020 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.054263 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.054442 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.054603 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.054750 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.054951 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.055103 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.055280 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.055531 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.055684 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.055831 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.055986 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.056146 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.056351 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.056596 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.056749 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.056992 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.057145 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.057145 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.057442 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.057619 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.057773 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.057921 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.058067 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.058221 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.058383 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.058383 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.058759 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.058945 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.059115 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.059281 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.059450 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.059636 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.059636 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.060054 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.060231 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.060457 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.060712 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.060866 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.061021 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.061021 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.061310 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.061470 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.077396 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.077536 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.077618 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.077708 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.077847 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.077962 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.078039 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.078123 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.078204 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.078284 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.078362 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.078441 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.078441 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.078570 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.078640 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.078717 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.078717 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.078931 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.078931 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.079072 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.079147 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.079225 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.079301 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.079385 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.079463 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.079553 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.079628 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.079698 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.079698 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.079835 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.079835 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.079971 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.080046 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.080142 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.080231 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.080312 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.080391 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.080468 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.080546 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.080643 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.080817 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.080907 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.080986 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.081058 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.081133 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.081133 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.081273 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.081344 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.081441 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.081513 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.081513 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.081649 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.081721 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.081799 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.081877 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.081948 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.082017 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.082017 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.082163 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.082242 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.082312 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.084991 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.085069 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.085150 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.085230 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.085300 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.085382 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.085459 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.085529 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.085607 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.085607 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.085750 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.085868 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.086466 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.086696 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.086790 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.086888 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.086960 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.087029 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.087098 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.087205 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.087305 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.087385 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.087464 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.087534 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.087610 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.087694 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.087765 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.087834 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.087902 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.087980 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.088051 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.088128 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.088207 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.088277 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.088277 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.088277 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.088277 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.088548 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.088619 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.088688 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.088757 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.088757 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.088895 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.088967 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.089037 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.089106 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.089106 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.089106 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.089308 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.089381 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.089457 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.089539 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.089539 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.089666 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.089748 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.089819 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.089955 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.090039 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.090110 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.090189 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.090262 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.090332 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.090401 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.093564 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.093753 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.093978 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.094944 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.095053 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.095140 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.095140 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.095300 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.095385 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.095385 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.095529 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.095600 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.095677 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.095755 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.095755 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.095912 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.095998 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.096082 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.096166 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.096263 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.096380 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.096523 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.096675 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.096816 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.096968 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.097142 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.097306 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.097463 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.097612 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.097762 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.097909 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.098083 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.098236 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.098385 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.098534 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.098682 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.098859 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.098859 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.099176 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.099324 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.099484 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.099630 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.099785 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.099914 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.100062 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.100207 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.100372 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.100533 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.100687 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.100838 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.100985 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.101147 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.101307 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.101457 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.101615 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.101615 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.101897 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.102049 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.102209 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.102359 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.102517 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.102669 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.106952 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.111279 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.114210 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.114413 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.114616 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.114780 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.115035 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.115213 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.115403 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.115577 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.115733 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.115888 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.116042 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.116207 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.116363 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.116363 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.116687 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.116840 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.117076 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.119595 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.119813 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.119980 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.120140 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.120295 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.120449 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.120610 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.120805 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.121067 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.121281 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.121451 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.121694 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.121858 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.122015 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.122167 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.122320 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.122514 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.122684 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.123023 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.123186 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.123340 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.124096 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.124626 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.124791 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.124954 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.125116 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.125277 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.125433 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.125596 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.125757 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.125910 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.126063 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.126216 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.126382 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.126556 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.126719 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.126902 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.127070 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.127230 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.127392 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.127557 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.127744 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.127744 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.128583 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.128849 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.129097 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.129625 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.129881 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.130130 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.130350 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.130603 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.130876 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.131133 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.131133 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.133453 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.134400 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.135334 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.135587 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.135862 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.136122 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.136340 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.136559 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.137286 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.137682 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.137901 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.138131 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.138358 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.138614 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.139006 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.139232 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.139450 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.139714 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.139960 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.140196 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.140424 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.140696 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.140993 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.141216 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.141432 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.141793 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.142027 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.142027 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.142459 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.142681 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.142970 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.143190 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.143412 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.143629 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.144510 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.144510 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.145220 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.145502 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.145735 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.145955 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.146177 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.146397 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.146626 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.146941 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.147242 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.147484 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.147703 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.148031 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.148263 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.148429 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.148594 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.148768 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.148933 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.149099 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.153636 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.156576 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.156746 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.156909 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.157041 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.157160 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.157277 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.157394 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.157526 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.157686 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.157838 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.157838 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.158071 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.158198 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.158327 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.158443 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.160354 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.160490 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.160581 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.160671 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.160753 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.160826 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.160904 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.160983 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.161055 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.161140 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.161260 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.161373 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.161449 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.161521 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.161600 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.161687 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.161768 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.161841 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.163168 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.163307 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.163425 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.163653 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.163772 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.163896 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.164474 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.164654 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.164808 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.164924 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.165036 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.165157 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.165285 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.165419 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.165544 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.165658 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.165769 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.165891 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.166046 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.166175 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.166306 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.167409 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.167642 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.167880 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.168246 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.168539 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.168716 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.168880 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.169075 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.169282 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.169440 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.169604 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.169830 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.170059 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.175082 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.175275 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.175275 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.175525 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.175525 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.175801 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.175950 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.176122 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.176255 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.176425 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.176566 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.176726 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.176867 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.177010 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.177187 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.177332 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.177470 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.177599 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.177754 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.177896 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.178039 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.178170 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.178306 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.178442 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.178584 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.178721 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.178964 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.179097 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.179266 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.179399 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.179527 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.179655 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.179792 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.179923 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.180060 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.180190 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.180354 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.180520 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.180663 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.180828 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.180969 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.181109 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.181247 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.181426 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.181558 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.181700 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.181831 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.181967 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.181967 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.182236 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.182366 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.182504 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.182633 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.182770 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.182926 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.183067 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.183198 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.183326 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.183497 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.183661 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.183807 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.183937 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.184074 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.184211 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.184349 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.184477 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.184614 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.184743 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.184905 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.185037 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.185167 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.185295 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.185438 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.185603 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.185742 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.185872 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.186000 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.186136 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.186279 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.186421 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.186551 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.186686 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.186862 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.187012 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.187145 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.187283 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.187412 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.187549 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.187678 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.187815 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.187951 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.187951 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.188201 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.188339 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.188476 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.188614 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.188751 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.188888 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.189016 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.189144 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.189281 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.189412 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.189545 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.189708 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.189844 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.189844 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.190094 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.190221 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.190355 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.190482 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.190609 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.190734 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.190894 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.191024 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.191159 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.191298 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.191435 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.191571 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.191712 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.191839 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.191973 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.192100 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.192235 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.192362 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.192504 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.192632 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.192765 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.192927 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.193068 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.193207 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.193345 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.193474 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.193786 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.193935 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.194066 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.194203 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.195255 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.195391 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.197657 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.197883 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.198061 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.198231 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.198383 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.198530 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.198684 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.198852 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.199006 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.199164 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.199851 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.199998 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.200164 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.200321 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.200546 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.200693 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.200837 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.201027 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.201185 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.201185 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.201476 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.201627 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.201802 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.202008 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.202169 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.202322 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.202476 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.202621 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.202772 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.203066 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.203214 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.203370 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.203516 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.203671 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.203823 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.203967 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.204112 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.204281 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.204426 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.204570 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.204714 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.204865 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.205016 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.205175 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.205328 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.205477 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.205632 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.205776 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.205929 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.206099 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.206244 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.206395 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.206539 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.206690 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.206892 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.207064 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.207218 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.207363 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.207514 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.207671 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.207825 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.207977 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.208140 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.208294 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.208438 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.208589 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.208747 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.208892 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.209070 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.209221 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.209374 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.209528 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.209672 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.209815 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.209994 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.210159 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.210313 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.210475 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.210620 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.210764 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.210987 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.211133 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.211287 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.211448 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102212) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 12 14:47:11.211595 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.211595 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.211595 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.211595 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.211595 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.211595 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.211595 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.211595 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.212671 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.212671 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.212671 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.212671 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.212671 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.212671 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.212671 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.212671 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.213788 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.213788 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.213788 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.213788 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.213788 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.213788 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.213788 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.213788 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.214974 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.214974 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.214974 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.214974 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.214974 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.214974 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.214974 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.216429 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.216429 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.216429 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.216429 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.216429 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.216429 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.216429 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.216429 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.217587 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.217587 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.217587 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.217587 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.217587 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.217587 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.217587 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.217587 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.218727 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.218727 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.218727 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.218727 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.218727 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.218727 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.218727 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.218727 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.219949 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.219949 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.219949 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.219949 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.219949 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.219949 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.219949 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.219949 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.221047 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.221047 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.221047 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.221047 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.221047 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.221047 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.221047 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.221047 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.222158 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.222158 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.222158 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.222158 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.222158 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.222158 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.222158 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.222158 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.223293 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.223293 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.223293 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.223293 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.223293 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.223293 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.223293 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.223293 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.224413 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.224413 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.224413 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.224413 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.224413 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.224413 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.224413 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.224413 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.225503 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.225503 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.225503 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.225928 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_db.sqlalchemy.engines [None req-fd93ad26-f846-4eb4-87a1-82c2559f7c90 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102212) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} May 12 14:47:11.226077 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.226077 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.226077 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.226077 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.226077 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.226077 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.226077 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.226077 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.227268 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.227268 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.227268 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.227268 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.227268 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.227268 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.227268 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.227268 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.230423 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.230423 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.230423 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.230423 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.230423 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.230423 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.230423 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.230423 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.231666 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.231666 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.231666 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.231666 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.231666 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.231666 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.231666 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.231666 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.232866 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.232866 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.232866 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.232866 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.232866 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.232866 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.232866 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.232866 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.233997 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.233997 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.233997 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.233997 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.233997 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.233997 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.233997 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.233997 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.235165 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.235165 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.235165 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.235165 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.235165 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.235165 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.235165 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.235165 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.236279 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.236279 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.236279 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.236279 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.236279 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.236279 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.236279 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.236279 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.237374 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.237374 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.237374 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.237374 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.237374 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.237374 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.237374 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.237374 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.238490 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.238490 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.238490 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.238490 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.238490 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.238490 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.238490 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.238490 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.239645 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.239645 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.239645 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.239645 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.239645 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.239645 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.239645 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.239645 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.240500 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.240500 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.240500 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.240500 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.240500 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.240500 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.240500 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.240500 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.241343 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.241343 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.241343 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.241343 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.241343 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.241343 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.241343 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.241343 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.242197 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.242197 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.242197 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.242197 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.242197 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.242197 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.242197 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.242197 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.243108 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.243108 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.243108 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.243108 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.243108 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.243108 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.243108 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.243108 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.244035 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.244035 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.244035 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.244035 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.244035 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 12 14:47:11.244035 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 12 14:47:11.273993 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_db.sqlalchemy.engines [None req-7a58b5e5-4d65-4ee7-ba17-17cf6f7685a4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102213) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} May 12 14:47:11.451981 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.context [None req-fd93ad26-f846-4eb4-87a1-82c2559f7c90 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),da96a16e-7498-4758-9db5-c67f00079eae(cell1) {{(pid=102212) load_cells /opt/stack/nova/nova/context.py:464}} May 12 14:47:11.456157 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-fd93ad26-f846-4eb4-87a1-82c2559f7c90 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:47:11.457839 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-fd93ad26-f846-4eb4-87a1-82c2559f7c90 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:47:11.458643 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-fd93ad26-f846-4eb4-87a1-82c2559f7c90 None None] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:47:11.460666 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-fd93ad26-f846-4eb4-87a1-82c2559f7c90 None None] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:47:11.493808 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_db.sqlalchemy.engines [None req-fd93ad26-f846-4eb4-87a1-82c2559f7c90 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102212) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} May 12 14:47:11.494952 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_db.sqlalchemy.engines [None req-fd93ad26-f846-4eb4-87a1-82c2559f7c90 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102212) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} May 12 14:47:11.526550 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_db.sqlalchemy.engines [None req-fd93ad26-f846-4eb4-87a1-82c2559f7c90 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102212) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} May 12 14:47:11.539431 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.context [None req-7a58b5e5-4d65-4ee7-ba17-17cf6f7685a4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),da96a16e-7498-4758-9db5-c67f00079eae(cell1) {{(pid=102213) load_cells /opt/stack/nova/nova/context.py:464}} May 12 14:47:11.544253 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-7a58b5e5-4d65-4ee7-ba17-17cf6f7685a4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:47:11.545931 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-7a58b5e5-4d65-4ee7-ba17-17cf6f7685a4 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:47:11.546736 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-7a58b5e5-4d65-4ee7-ba17-17cf6f7685a4 None None] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:47:11.548781 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-7a58b5e5-4d65-4ee7-ba17-17cf6f7685a4 None None] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:47:11.579977 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_db.sqlalchemy.engines [None req-7a58b5e5-4d65-4ee7-ba17-17cf6f7685a4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102213) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} May 12 14:47:11.581826 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_db.sqlalchemy.engines [None req-7a58b5e5-4d65-4ee7-ba17-17cf6f7685a4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102213) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} May 12 14:47:11.616499 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_db.sqlalchemy.engines [None req-7a58b5e5-4d65-4ee7-ba17-17cf6f7685a4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102213) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} May 12 14:47:11.770861 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO keyring.backend [None req-fd93ad26-f846-4eb4-87a1-82c2559f7c90 None None] Loading KWallet May 12 14:47:11.780088 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO keyring.backend [None req-fd93ad26-f846-4eb4-87a1-82c2559f7c90 None None] Loading SecretService May 12 14:47:11.783397 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 14:47:11.783397 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: from cryptography.utils import int_from_bytes May 12 14:47:11.783720 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 14:47:11.783720 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: from cryptography.utils import int_from_bytes May 12 14:47:11.784635 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO keyring.backend [None req-fd93ad26-f846-4eb4-87a1-82c2559f7c90 None None] Loading Windows May 12 14:47:11.786479 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO keyring.backend [None req-fd93ad26-f846-4eb4-87a1-82c2559f7c90 None None] Loading chainer May 12 14:47:11.787308 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO keyring.backend [None req-fd93ad26-f846-4eb4-87a1-82c2559f7c90 None None] Loading macOS May 12 14:47:11.859997 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO keyring.backend [None req-7a58b5e5-4d65-4ee7-ba17-17cf6f7685a4 None None] Loading KWallet May 12 14:47:11.868895 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO keyring.backend [None req-7a58b5e5-4d65-4ee7-ba17-17cf6f7685a4 None None] Loading SecretService May 12 14:47:11.872257 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 14:47:11.872257 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: from cryptography.utils import int_from_bytes May 12 14:47:11.872574 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 12 14:47:11.872574 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: from cryptography.utils import int_from_bytes May 12 14:47:11.873480 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO keyring.backend [None req-7a58b5e5-4d65-4ee7-ba17-17cf6f7685a4 None None] Loading Windows May 12 14:47:11.875362 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO keyring.backend [None req-7a58b5e5-4d65-4ee7-ba17-17cf6f7685a4 None None] Loading chainer May 12 14:47:11.876149 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO keyring.backend [None req-7a58b5e5-4d65-4ee7-ba17-17cf6f7685a4 None None] Loading macOS May 12 14:47:12.038857 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: WARNING keystonemiddleware.auth_token [None req-fd93ad26-f846-4eb4-87a1-82c2559f7c90 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 12 14:47:12.045942 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: WARNING keystonemiddleware.auth_token [None req-fd93ad26-f846-4eb4-87a1-82c2559f7c90 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 12 14:47:12.133919 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: WARNING keystonemiddleware.auth_token [None req-7a58b5e5-4d65-4ee7-ba17-17cf6f7685a4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 12 14:47:12.141322 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: WARNING keystonemiddleware.auth_token [None req-7a58b5e5-4d65-4ee7-ba17-17cf6f7685a4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 12 14:47:12.256630 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: WARNING keystonemiddleware.auth_token [None req-fd93ad26-f846-4eb4-87a1-82c2559f7c90 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 12 14:47:12.261851 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: WARNING keystonemiddleware.auth_token [None req-fd93ad26-f846-4eb4-87a1-82c2559f7c90 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 12 14:47:12.268027 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d6dfb2e9c0 pid: 102212 (default app) May 12 14:47:12.360922 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: WARNING keystonemiddleware.auth_token [None req-7a58b5e5-4d65-4ee7-ba17-17cf6f7685a4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 12 14:47:12.366051 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: WARNING keystonemiddleware.auth_token [None req-7a58b5e5-4d65-4ee7-ba17-17cf6f7685a4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 12 14:47:12.372316 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d6dfb2e9c0 pid: 102213 (default app) May 12 14:48:02.283872 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-8746fc69-357f-4fdb-b7c6-4d02c317a447 tempest-VolumesGetTestJSON-1013002944 tempest-VolumesGetTestJSON-1013002944-project] Action: 'create', calling method: .version_select at 0x7ff78078e940>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-919550435", "metadata": {"Type": "work"}}} {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:48:04.331301 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-8746fc69-357f-4fdb-b7c6-4d02c317a447 tempest-VolumesGetTestJSON-1013002944 tempest-VolumesGetTestJSON-1013002944-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.354728 May 12 14:48:04.345460 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 1/1] 10.222.0.49 () {60 vars in 1155 bytes} [Thu May 12 14:48:00 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 3370 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 12 14:48:04.938720 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-7c8710e0-a9d4-4e4e-b43b-013afdc583dc tempest-VolumesGetTestJSON-1013002944 tempest-VolumesGetTestJSON-1013002944-project] Calling method '.version_select at 0x7ff780709b80>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:05.421461 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-7c8710e0-a9d4-4e4e-b43b-013afdc583dc tempest-VolumesGetTestJSON-1013002944 tempest-VolumesGetTestJSON-1013002944-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/762ee5c2-5228-4161-b9a8-d01b56038676" status: 200 len: 352 microversion: 2.1 time: 1.079779 May 12 14:48:05.422147 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 1/2] 10.222.0.49 () {58 vars in 1244 bytes} [Thu May 12 14:48:04 2022] GET /compute/v2.1/os-volumes/762ee5c2-5228-4161-b9a8-d01b56038676 => generated 352 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:48:06.437394 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-35575350-30bb-4cef-ab86-277a0d016115 tempest-VolumesGetTestJSON-1013002944 tempest-VolumesGetTestJSON-1013002944-project] Calling method '.version_select at 0x7ff78059a310>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:06.601305 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-35575350-30bb-4cef-ab86-277a0d016115 tempest-VolumesGetTestJSON-1013002944 tempest-VolumesGetTestJSON-1013002944-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/762ee5c2-5228-4161-b9a8-d01b56038676" status: 200 len: 353 microversion: 2.1 time: 0.169432 May 12 14:48:06.602219 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 2/3] 10.222.0.49 () {58 vars in 1244 bytes} [Thu May 12 14:48:06 2022] GET /compute/v2.1/os-volumes/762ee5c2-5228-4161-b9a8-d01b56038676 => generated 353 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:48:06.614597 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-f979e4eb-8f16-4a91-bb64-b2d8f8a01e11 tempest-VolumesGetTestJSON-1013002944 tempest-VolumesGetTestJSON-1013002944-project] Calling method '.version_select at 0x7ff7805e3310>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:06.771503 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-f979e4eb-8f16-4a91-bb64-b2d8f8a01e11 tempest-VolumesGetTestJSON-1013002944 tempest-VolumesGetTestJSON-1013002944-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/762ee5c2-5228-4161-b9a8-d01b56038676" status: 200 len: 353 microversion: 2.1 time: 0.161441 May 12 14:48:06.772310 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 2/4] 10.222.0.49 () {58 vars in 1244 bytes} [Thu May 12 14:48:06 2022] GET /compute/v2.1/os-volumes/762ee5c2-5228-4161-b9a8-d01b56038676 => generated 353 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:48:06.789391 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-31e6080b-f5fe-41a4-b765-92345188f60b tempest-VolumesGetTestJSON-1013002944 tempest-VolumesGetTestJSON-1013002944-project] Calling method '.version_select at 0x7ff7805e3b80>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:07.063497 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-31e6080b-f5fe-41a4-b765-92345188f60b tempest-VolumesGetTestJSON-1013002944 tempest-VolumesGetTestJSON-1013002944-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/762ee5c2-5228-4161-b9a8-d01b56038676" status: 202 len: 0 microversion: 2.1 time: 0.277266 May 12 14:48:07.064268 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 3/5] 10.222.0.49 () {58 vars in 1247 bytes} [Thu May 12 14:48:06 2022] DELETE /compute/v2.1/os-volumes/762ee5c2-5228-4161-b9a8-d01b56038676 => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 14:48:07.071134 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-51a0f197-593a-4a97-b65c-a8655f64e315 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-503082030", "imageRef": "a4587ab2-5f51-46a3-a023-0e6778ccaaa1", "flavorRef": "452", "networks": [{"uuid": "3bb0c2b6-df17-46cb-a5bb-4e321124174a"}]}} {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:48:07.089969 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-df3abb52-91d9-42d0-a157-0277ab10d92b tempest-VolumesGetTestJSON-1013002944 tempest-VolumesGetTestJSON-1013002944-project] Calling method '.version_select at 0x7ff780595280>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:07.350889 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.network.neutron [None req-51a0f197-593a-4a97-b65c-a8655f64e315 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] validate_networks() for [('3bb0c2b6-df17-46cb-a5bb-4e321124174a', None, None, None)] {{(pid=102212) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} May 12 14:48:07.374408 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-df3abb52-91d9-42d0-a157-0277ab10d92b tempest-VolumesGetTestJSON-1013002944 tempest-VolumesGetTestJSON-1013002944-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/762ee5c2-5228-4161-b9a8-d01b56038676" status: 200 len: 352 microversion: 2.1 time: 0.304779 May 12 14:48:07.374999 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 4/6] 10.222.0.49 () {58 vars in 1244 bytes} [Thu May 12 14:48:07 2022] GET /compute/v2.1/os-volumes/762ee5c2-5228-4161-b9a8-d01b56038676 => generated 352 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:48:08.387621 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-15ff1a5c-7af8-41b2-85e2-77a62be5b174 tempest-VolumesGetTestJSON-1013002944 tempest-VolumesGetTestJSON-1013002944-project] Calling method '.version_select at 0x7ff7805e3f70>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:08.455016 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.wsgi [None req-15ff1a5c-7af8-41b2-85e2-77a62be5b174 tempest-VolumesGetTestJSON-1013002944 tempest-VolumesGetTestJSON-1013002944-project] HTTP exception thrown: Volume 762ee5c2-5228-4161-b9a8-d01b56038676 could not be found. May 12 14:48:08.455902 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-15ff1a5c-7af8-41b2-85e2-77a62be5b174 tempest-VolumesGetTestJSON-1013002944 tempest-VolumesGetTestJSON-1013002944-project] Returning 404 to user: Volume 762ee5c2-5228-4161-b9a8-d01b56038676 could not be found. {{(pid=102213) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 12 14:48:08.456971 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-15ff1a5c-7af8-41b2-85e2-77a62be5b174 tempest-VolumesGetTestJSON-1013002944 tempest-VolumesGetTestJSON-1013002944-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/762ee5c2-5228-4161-b9a8-d01b56038676" status: 404 len: 109 microversion: 2.1 time: 0.073981 May 12 14:48:08.458010 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 5/7] 10.222.0.49 () {58 vars in 1244 bytes} [Thu May 12 14:48:08 2022] GET /compute/v2.1/os-volumes/762ee5c2-5228-4161-b9a8-d01b56038676 => generated 109 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 12 14:48:09.267151 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.virt.hardware [None req-51a0f197-593a-4a97-b65c-a8655f64e315 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Flavor limits 0:0:0 {{(pid=102212) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 14:48:09.267644 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.virt.hardware [None req-51a0f197-593a-4a97-b65c-a8655f64e315 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Image limits 0:0:0 {{(pid=102212) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 14:48:09.270079 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.virt.hardware [None req-51a0f197-593a-4a97-b65c-a8655f64e315 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Flavor pref 0:0:0 {{(pid=102212) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 14:48:09.270512 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.virt.hardware [None req-51a0f197-593a-4a97-b65c-a8655f64e315 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Image pref 0:0:0 {{(pid=102212) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 14:48:09.272487 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.virt.hardware [None req-51a0f197-593a-4a97-b65c-a8655f64e315 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=102212) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 14:48:09.305191 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-51a0f197-593a-4a97-b65c-a8655f64e315 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:09.305994 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-51a0f197-593a-4a97-b65c-a8655f64e315 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:09.307282 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-51a0f197-593a-4a97-b65c-a8655f64e315 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:09.308438 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-51a0f197-593a-4a97-b65c-a8655f64e315 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:09.341937 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.quota [None req-51a0f197-593a-4a97-b65c-a8655f64e315 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Getting quotas for project 4a0fc219e42a416ea2f81435544b43bd. Resources: {'cores', 'ram', 'instances'} {{(pid=102212) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 12 14:48:09.351210 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.quota [None req-51a0f197-593a-4a97-b65c-a8655f64e315 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Getting quotas for user 1458fa830b624a1cb64917dc815206ce and project 4a0fc219e42a416ea2f81435544b43bd. Resources: {'cores', 'ram', 'instances'} {{(pid=102212) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 12 14:48:09.381133 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-51a0f197-593a-4a97-b65c-a8655f64e315 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Going to run 1 instances... {{(pid=102212) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 12 14:48:09.384471 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-51a0f197-593a-4a97-b65c-a8655f64e315 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] [instance: dac49498-274f-4b45-ac30-0523cf21ee74] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a4587ab2-5f51-46a3-a023-0e6778ccaaa1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=102212) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} May 12 14:48:09.633491 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-51a0f197-593a-4a97-b65c-a8655f64e315 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.930814 May 12 14:48:09.634726 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 3/8] 10.222.0.49 () {60 vars in 1146 bytes} [Thu May 12 14:48:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 2933 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 14:48:09.645699 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-9f5c3052-ffe0-4611-9bcc-ed4c8198b9e3 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:09.646589 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-9f5c3052-ffe0-4611-9bcc-ed4c8198b9e3 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] [instance: dac49498-274f-4b45-ac30-0523cf21ee74] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:48:09.865407 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-9f5c3052-ffe0-4611-9bcc-ed4c8198b9e3 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1458fa830b624a1cb64917dc815206ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0fc219e42a416ea2f81435544b43bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:48:09.888319 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-9f5c3052-ffe0-4611-9bcc-ed4c8198b9e3 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] 10.222.0.49 "GET /compute/v2.1/servers/dac49498-274f-4b45-ac30-0523cf21ee74" status: 200 len: 1214 microversion: 2.1 time: 0.246930 May 12 14:48:09.888903 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 6/9] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:48:09 2022] GET /compute/v2.1/servers/dac49498-274f-4b45-ac30-0523cf21ee74 => generated 1214 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:48:10.909910 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-395bab3d-447f-4df0-a83c-eb3b5243045c tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:10.916279 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-395bab3d-447f-4df0-a83c-eb3b5243045c tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] [instance: dac49498-274f-4b45-ac30-0523cf21ee74] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:48:11.125647 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-395bab3d-447f-4df0-a83c-eb3b5243045c tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1458fa830b624a1cb64917dc815206ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0fc219e42a416ea2f81435544b43bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:48:11.172991 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-395bab3d-447f-4df0-a83c-eb3b5243045c tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] 10.222.0.49 "GET /compute/v2.1/servers/dac49498-274f-4b45-ac30-0523cf21ee74" status: 200 len: 1214 microversion: 2.1 time: 0.267848 May 12 14:48:11.182726 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 4/10] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:48:10 2022] GET /compute/v2.1/servers/dac49498-274f-4b45-ac30-0523cf21ee74 => generated 1214 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:48:12.189298 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-d4fe71a4-ac68-4820-b779-4767cab16559 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:12.190539 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-d4fe71a4-ac68-4820-b779-4767cab16559 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] [instance: dac49498-274f-4b45-ac30-0523cf21ee74] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:48:12.206524 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-d4fe71a4-ac68-4820-b779-4767cab16559 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:12.207084 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-d4fe71a4-ac68-4820-b779-4767cab16559 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:12.210774 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-d4fe71a4-ac68-4820-b779-4767cab16559 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:12.219269 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-d4fe71a4-ac68-4820-b779-4767cab16559 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:12.598919 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-d4fe71a4-ac68-4820-b779-4767cab16559 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1458fa830b624a1cb64917dc815206ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0fc219e42a416ea2f81435544b43bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:48:12.619229 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-d4fe71a4-ac68-4820-b779-4767cab16559 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] 10.222.0.49 "GET /compute/v2.1/servers/dac49498-274f-4b45-ac30-0523cf21ee74" status: 200 len: 1218 microversion: 2.1 time: 0.433430 May 12 14:48:12.620693 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 7/11] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:48:12 2022] GET /compute/v2.1/servers/dac49498-274f-4b45-ac30-0523cf21ee74 => generated 1218 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:48:13.637194 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-be04b76e-9cdf-4e47-b554-67b56c2a3e87 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:13.638463 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-be04b76e-9cdf-4e47-b554-67b56c2a3e87 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] [instance: dac49498-274f-4b45-ac30-0523cf21ee74] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:48:13.661897 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-be04b76e-9cdf-4e47-b554-67b56c2a3e87 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:13.662571 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-be04b76e-9cdf-4e47-b554-67b56c2a3e87 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:13.664762 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-be04b76e-9cdf-4e47-b554-67b56c2a3e87 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:13.675298 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-be04b76e-9cdf-4e47-b554-67b56c2a3e87 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:14.227461 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-be04b76e-9cdf-4e47-b554-67b56c2a3e87 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1458fa830b624a1cb64917dc815206ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0fc219e42a416ea2f81435544b43bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:48:14.251803 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-be04b76e-9cdf-4e47-b554-67b56c2a3e87 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] 10.222.0.49 "GET /compute/v2.1/servers/dac49498-274f-4b45-ac30-0523cf21ee74" status: 200 len: 1210 microversion: 2.1 time: 0.618895 May 12 14:48:14.252917 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 5/12] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:48:13 2022] GET /compute/v2.1/servers/dac49498-274f-4b45-ac30-0523cf21ee74 => generated 1210 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:48:15.271633 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-703c3b41-cf43-4270-bbea-b9c87d46063d tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:15.272791 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-703c3b41-cf43-4270-bbea-b9c87d46063d tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] [instance: dac49498-274f-4b45-ac30-0523cf21ee74] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:48:15.285136 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-703c3b41-cf43-4270-bbea-b9c87d46063d tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:15.290728 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-703c3b41-cf43-4270-bbea-b9c87d46063d tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:15.291780 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-703c3b41-cf43-4270-bbea-b9c87d46063d tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:15.299590 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-703c3b41-cf43-4270-bbea-b9c87d46063d tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:16.123844 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-703c3b41-cf43-4270-bbea-b9c87d46063d tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1458fa830b624a1cb64917dc815206ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0fc219e42a416ea2f81435544b43bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:48:16.134405 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-703c3b41-cf43-4270-bbea-b9c87d46063d tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] 10.222.0.49 "GET /compute/v2.1/servers/dac49498-274f-4b45-ac30-0523cf21ee74" status: 200 len: 1284 microversion: 2.1 time: 0.866290 May 12 14:48:16.141654 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 8/13] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:48:15 2022] GET /compute/v2.1/servers/dac49498-274f-4b45-ac30-0523cf21ee74 => generated 1284 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:48:17.158589 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-77c3f856-f420-42b2-8858-3ba6e3efc972 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:17.159841 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-77c3f856-f420-42b2-8858-3ba6e3efc972 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] [instance: dac49498-274f-4b45-ac30-0523cf21ee74] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:48:17.170566 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-77c3f856-f420-42b2-8858-3ba6e3efc972 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:17.175390 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-77c3f856-f420-42b2-8858-3ba6e3efc972 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:17.177665 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-77c3f856-f420-42b2-8858-3ba6e3efc972 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:17.181174 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-77c3f856-f420-42b2-8858-3ba6e3efc972 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:17.630045 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-77c3f856-f420-42b2-8858-3ba6e3efc972 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1458fa830b624a1cb64917dc815206ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0fc219e42a416ea2f81435544b43bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:48:17.647757 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-77c3f856-f420-42b2-8858-3ba6e3efc972 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] 10.222.0.49 "GET /compute/v2.1/servers/dac49498-274f-4b45-ac30-0523cf21ee74" status: 200 len: 1272 microversion: 2.1 time: 0.493908 May 12 14:48:17.655234 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 6/14] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:48:17 2022] GET /compute/v2.1/servers/dac49498-274f-4b45-ac30-0523cf21ee74 => generated 1272 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:48:18.669617 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-28a3bb6a-b24c-4c78-941b-b035b163146c tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:18.670969 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-28a3bb6a-b24c-4c78-941b-b035b163146c tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] [instance: dac49498-274f-4b45-ac30-0523cf21ee74] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:48:18.697244 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-28a3bb6a-b24c-4c78-941b-b035b163146c tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:18.700179 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-28a3bb6a-b24c-4c78-941b-b035b163146c tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:18.703845 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-28a3bb6a-b24c-4c78-941b-b035b163146c tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:18.703845 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-28a3bb6a-b24c-4c78-941b-b035b163146c tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:18.947436 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-28a3bb6a-b24c-4c78-941b-b035b163146c tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1458fa830b624a1cb64917dc815206ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0fc219e42a416ea2f81435544b43bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:48:18.999878 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-28a3bb6a-b24c-4c78-941b-b035b163146c tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] 10.222.0.49 "GET /compute/v2.1/servers/dac49498-274f-4b45-ac30-0523cf21ee74" status: 200 len: 1272 microversion: 2.1 time: 0.325757 May 12 14:48:19.000733 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 9/15] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:48:18 2022] GET /compute/v2.1/servers/dac49498-274f-4b45-ac30-0523cf21ee74 => generated 1272 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:48:20.027208 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-8016769c-c69a-4235-9047-05f46f65e493 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:20.030354 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-8016769c-c69a-4235-9047-05f46f65e493 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] [instance: dac49498-274f-4b45-ac30-0523cf21ee74] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:48:20.041545 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-8016769c-c69a-4235-9047-05f46f65e493 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:20.042794 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-8016769c-c69a-4235-9047-05f46f65e493 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:20.043923 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-8016769c-c69a-4235-9047-05f46f65e493 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:20.054326 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-8016769c-c69a-4235-9047-05f46f65e493 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:20.363924 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-fbc623eb-1108-438a-90d8-6b9c674db0fa tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Action: 'create', calling method: .version_select at 0x7ff7804dbc10>, body: {"keypair": {"name": "tempest-keypair-1676010479", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKe4RurnffQMFnwwBr1379bF7XkFW2rg4vMIsZCx78Mzg8r8hlAH+4Z1O+CWT16GVqIN2ZXVn8w95B8PvcdG80K2TIf4Z0B51nXzCWLY9UVsvggmZNzhFxDvanFbjiXDQw=="}} {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:48:20.390547 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-8016769c-c69a-4235-9047-05f46f65e493 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1458fa830b624a1cb64917dc815206ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0fc219e42a416ea2f81435544b43bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:48:20.407069 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-8016769c-c69a-4235-9047-05f46f65e493 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] 10.222.0.49 "GET /compute/v2.1/servers/dac49498-274f-4b45-ac30-0523cf21ee74" status: 200 len: 1272 microversion: 2.1 time: 0.393041 May 12 14:48:20.414966 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 7/16] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:48:20 2022] GET /compute/v2.1/servers/dac49498-274f-4b45-ac30-0523cf21ee74 => generated 1272 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:48:20.545595 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.quota [None req-fbc623eb-1108-438a-90d8-6b9c674db0fa tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Getting quotas for project a090a68e336b4562aca524a95f550e04. Resources: {'key_pairs'} {{(pid=102213) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 12 14:48:20.545595 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.quota [None req-fbc623eb-1108-438a-90d8-6b9c674db0fa tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Getting quotas for user b0e128ca83d6448c9ab1fe7dcc5467d4 and project a090a68e336b4562aca524a95f550e04. Resources: {'key_pairs'} {{(pid=102213) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 12 14:48:20.798267 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-fbc623eb-1108-438a-90d8-6b9c674db0fa tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.771146 May 12 14:48:20.799321 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 10/17] 10.222.0.49 () {60 vars in 1158 bytes} [Thu May 12 14:48:20 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 14:48:21.429423 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-5e3f0b6f-6a62-4ddf-8234-e01af52591ae tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:21.430127 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-5e3f0b6f-6a62-4ddf-8234-e01af52591ae tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] [instance: dac49498-274f-4b45-ac30-0523cf21ee74] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:48:21.443832 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-5e3f0b6f-6a62-4ddf-8234-e01af52591ae tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:21.453182 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-5e3f0b6f-6a62-4ddf-8234-e01af52591ae tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:21.454493 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-5e3f0b6f-6a62-4ddf-8234-e01af52591ae tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:21.463521 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-5e3f0b6f-6a62-4ddf-8234-e01af52591ae tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:22.956102 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-5e3f0b6f-6a62-4ddf-8234-e01af52591ae tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1458fa830b624a1cb64917dc815206ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0fc219e42a416ea2f81435544b43bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:48:22.969151 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-5e3f0b6f-6a62-4ddf-8234-e01af52591ae tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] 10.222.0.49 "GET /compute/v2.1/servers/dac49498-274f-4b45-ac30-0523cf21ee74" status: 200 len: 1314 microversion: 2.1 time: 1.543834 May 12 14:48:22.986806 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 8/18] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:48:21 2022] GET /compute/v2.1/servers/dac49498-274f-4b45-ac30-0523cf21ee74 => generated 1314 bytes in 1562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:48:24.006320 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-50dc7974-ef1d-4e33-a461-3c51c968d9fb tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:24.007113 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-50dc7974-ef1d-4e33-a461-3c51c968d9fb tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] [instance: dac49498-274f-4b45-ac30-0523cf21ee74] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:48:24.024620 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-50dc7974-ef1d-4e33-a461-3c51c968d9fb tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:24.025207 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-50dc7974-ef1d-4e33-a461-3c51c968d9fb tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:24.026893 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-50dc7974-ef1d-4e33-a461-3c51c968d9fb tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:24.027595 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-50dc7974-ef1d-4e33-a461-3c51c968d9fb tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:25.587639 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-586192df-c46c-4e46-9527-5a0cf64e86f8 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1924575302", "imageRef": "a4587ab2-5f51-46a3-a023-0e6778ccaaa1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:48:25.833939 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.network.neutron [None req-586192df-c46c-4e46-9527-5a0cf64e86f8 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] validate_networks() for [('faf0fd87-b01d-4638-a1db-c3f32b222877', None, None, None)] {{(pid=102212) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} May 12 14:48:26.825297 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-50dc7974-ef1d-4e33-a461-3c51c968d9fb tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1458fa830b624a1cb64917dc815206ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0fc219e42a416ea2f81435544b43bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:48:26.849298 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-50dc7974-ef1d-4e33-a461-3c51c968d9fb tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] 10.222.0.49 "GET /compute/v2.1/servers/dac49498-274f-4b45-ac30-0523cf21ee74" status: 200 len: 1314 microversion: 2.1 time: 2.834637 May 12 14:48:26.859586 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 11/19] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:48:24 2022] GET /compute/v2.1/servers/dac49498-274f-4b45-ac30-0523cf21ee74 => generated 1314 bytes in 2858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:48:27.820724 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [req-01834c5c-a078-4f84-a525-1818b9a64fe7 req-cbacb1de-14cb-4346-83c4-632d559b6b00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dac49498-274f-4b45-ac30-0523cf21ee74", "tag": "2044ac30-5708-42cb-b26e-840d25d8c8a6"}]} {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:48:27.823106 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:48:27.823106 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: warnings.warn(msg) May 12 14:48:27.842338 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [req-01834c5c-a078-4f84-a525-1818b9a64fe7 req-cbacb1de-14cb-4346-83c4-632d559b6b00 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:27.843565 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [req-01834c5c-a078-4f84-a525-1818b9a64fe7 req-cbacb1de-14cb-4346-83c4-632d559b6b00 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:27.934725 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.compute.server_external_events [req-01834c5c-a078-4f84-a525-1818b9a64fe7 req-cbacb1de-14cb-4346-83c4-632d559b6b00 service nova] Creating event network-changed:2044ac30-5708-42cb-b26e-840d25d8c8a6 for instance dac49498-274f-4b45-ac30-0523cf21ee74 on hv-cinder-83118 May 12 14:48:27.940836 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [req-01834c5c-a078-4f84-a525-1818b9a64fe7 req-cbacb1de-14cb-4346-83c4-632d559b6b00 service nova] Acquired lock "compute-rpcapi-router" {{(pid=102213) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} May 12 14:48:27.950465 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-5c0da288-bde5-4034-9448-d60821bbc6ef None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:27.951803 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-5c0da288-bde5-4034-9448-d60821bbc6ef None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:27.962019 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-5c0da288-bde5-4034-9448-d60821bbc6ef None None] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:27.962019 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-5c0da288-bde5-4034-9448-d60821bbc6ef None None] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:28.015845 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.compute.rpcapi [None req-5c0da288-bde5-4034-9448-d60821bbc6ef None None] Automatically selected compute RPC version 6.0 from minimum service version 56 May 12 14:48:28.017758 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-5c0da288-bde5-4034-9448-d60821bbc6ef None None] Releasing lock "compute-rpcapi-router" {{(pid=102213) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} May 12 14:48:28.078784 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-5c0da288-bde5-4034-9448-d60821bbc6ef None None] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.688009 May 12 14:48:28.084566 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 12/20] 10.222.0.49 () {64 vars in 1317 bytes} [Thu May 12 14:48:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 14:48:28.106160 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-eba3e6a0-5cab-42be-a740-6a375943bfc3 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:28.125349 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-eba3e6a0-5cab-42be-a740-6a375943bfc3 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] [instance: dac49498-274f-4b45-ac30-0523cf21ee74] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:48:28.175146 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-eba3e6a0-5cab-42be-a740-6a375943bfc3 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:28.183274 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-eba3e6a0-5cab-42be-a740-6a375943bfc3 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:28.184353 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-eba3e6a0-5cab-42be-a740-6a375943bfc3 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:28.190172 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-eba3e6a0-5cab-42be-a740-6a375943bfc3 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:28.268891 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.virt.hardware [None req-586192df-c46c-4e46-9527-5a0cf64e86f8 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Flavor limits 0:0:0 {{(pid=102212) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 14:48:28.269378 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.virt.hardware [None req-586192df-c46c-4e46-9527-5a0cf64e86f8 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Image limits 0:0:0 {{(pid=102212) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 14:48:28.270167 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.virt.hardware [None req-586192df-c46c-4e46-9527-5a0cf64e86f8 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Flavor pref 0:0:0 {{(pid=102212) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 14:48:28.270745 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.virt.hardware [None req-586192df-c46c-4e46-9527-5a0cf64e86f8 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Image pref 0:0:0 {{(pid=102212) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 14:48:28.271461 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.virt.hardware [None req-586192df-c46c-4e46-9527-5a0cf64e86f8 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=102212) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 14:48:28.290113 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-586192df-c46c-4e46-9527-5a0cf64e86f8 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:28.291169 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-586192df-c46c-4e46-9527-5a0cf64e86f8 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:28.295139 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-586192df-c46c-4e46-9527-5a0cf64e86f8 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:28.295932 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-586192df-c46c-4e46-9527-5a0cf64e86f8 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:28.374534 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.quota [None req-586192df-c46c-4e46-9527-5a0cf64e86f8 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Getting quotas for project 0301badcd92e4cc483246a0fa4949060. Resources: {'cores', 'ram', 'instances'} {{(pid=102212) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 12 14:48:28.392125 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.quota [None req-586192df-c46c-4e46-9527-5a0cf64e86f8 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Getting quotas for user ccce5e3f8320498ea48fa16c7d811ee1 and project 0301badcd92e4cc483246a0fa4949060. Resources: {'cores', 'ram', 'instances'} {{(pid=102212) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 12 14:48:28.440086 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-586192df-c46c-4e46-9527-5a0cf64e86f8 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Going to run 1 instances... {{(pid=102212) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 12 14:48:28.454606 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-586192df-c46c-4e46-9527-5a0cf64e86f8 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a4587ab2-5f51-46a3-a023-0e6778ccaaa1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=102212) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} May 12 14:48:28.644844 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-586192df-c46c-4e46-9527-5a0cf64e86f8 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.903962 May 12 14:48:28.645510 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 9/21] 10.222.0.49 () {60 vars in 1146 bytes} [Thu May 12 14:48:24 2022] POST /compute/v2.1/servers => generated 383 bytes in 3905 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 14:48:29.712916 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-9e29487e-2be0-40e9-9c81-6bfafdbe2f42 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Action: 'create', calling method: .version_select at 0x7ff780b39670>, body: {"keypair": {"name": "tempest-keypair-1319823142", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJTiDSqGJVyDthhf9x4FRXBVmqy9HBkAWAtbHFuPWTLEB5c9uBEeB6el3vcSqhRnmzcxEOUma4ZUtjkKNubDYRZ1HGjHzceGeuR6HBdykUfJulSYAQJUgnBpmcB5PmE2JQ=="}} {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:48:29.781385 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.quota [None req-9e29487e-2be0-40e9-9c81-6bfafdbe2f42 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Getting quotas for project 67a8451272cc41ebaf1598ed940bf09a. Resources: {'key_pairs'} {{(pid=102212) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 12 14:48:29.804832 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.quota [None req-9e29487e-2be0-40e9-9c81-6bfafdbe2f42 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Getting quotas for user 6a641a08648b454780081ecc2e291066 and project 67a8451272cc41ebaf1598ed940bf09a. Resources: {'key_pairs'} {{(pid=102212) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 12 14:48:29.841882 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-eba3e6a0-5cab-42be-a740-6a375943bfc3 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1458fa830b624a1cb64917dc815206ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0fc219e42a416ea2f81435544b43bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:48:29.857666 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-eba3e6a0-5cab-42be-a740-6a375943bfc3 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] 10.222.0.49 "GET /compute/v2.1/servers/dac49498-274f-4b45-ac30-0523cf21ee74" status: 200 len: 1314 microversion: 2.1 time: 1.770912 May 12 14:48:29.859173 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 13/22] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:48:28 2022] GET /compute/v2.1/servers/dac49498-274f-4b45-ac30-0523cf21ee74 => generated 1314 bytes in 1774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:48:29.868125 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-18303db0-ba3e-4202-9030-8e193b6d5471 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:29.870386 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-18303db0-ba3e-4202-9030-8e193b6d5471 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:48:30.027541 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-18303db0-ba3e-4202-9030-8e193b6d5471 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:48:30.046398 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-18303db0-ba3e-4202-9030-8e193b6d5471 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1" status: 200 len: 1222 microversion: 2.1 time: 0.180030 May 12 14:48:30.046398 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 14/23] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:48:29 2022] GET /compute/v2.1/servers/d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1 => generated 1222 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:48:30.084969 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-9e29487e-2be0-40e9-9c81-6bfafdbe2f42 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.438146 May 12 14:48:30.087122 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 10/24] 10.222.0.49 () {60 vars in 1158 bytes} [Thu May 12 14:48:28 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1441 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:48:30.248195 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-9073fee1-ef6e-45f3-8799-73a09888fba5 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1839220898", "imageRef": "a4587ab2-5f51-46a3-a023-0e6778ccaaa1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:48:30.370987 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.network.neutron [None req-9073fee1-ef6e-45f3-8799-73a09888fba5 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] validate_networks() for [('faf0fd87-b01d-4638-a1db-c3f32b222877', None, None, None)] {{(pid=102213) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} May 12 14:48:30.882565 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-809deb9c-f423-4a6f-9de6-b31d50c39656 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:30.884286 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-809deb9c-f423-4a6f-9de6-b31d50c39656 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] [instance: dac49498-274f-4b45-ac30-0523cf21ee74] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:48:30.905084 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-809deb9c-f423-4a6f-9de6-b31d50c39656 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:30.910748 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-809deb9c-f423-4a6f-9de6-b31d50c39656 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:30.919675 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-809deb9c-f423-4a6f-9de6-b31d50c39656 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:30.919675 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-809deb9c-f423-4a6f-9de6-b31d50c39656 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:32.062468 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-809deb9c-f423-4a6f-9de6-b31d50c39656 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1458fa830b624a1cb64917dc815206ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0fc219e42a416ea2f81435544b43bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:48:32.069553 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.virt.hardware [None req-9073fee1-ef6e-45f3-8799-73a09888fba5 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Flavor limits 0:0:0 {{(pid=102213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 14:48:32.070035 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.virt.hardware [None req-9073fee1-ef6e-45f3-8799-73a09888fba5 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Image limits 0:0:0 {{(pid=102213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 14:48:32.070908 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.virt.hardware [None req-9073fee1-ef6e-45f3-8799-73a09888fba5 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Flavor pref 0:0:0 {{(pid=102213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 14:48:32.071481 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.virt.hardware [None req-9073fee1-ef6e-45f3-8799-73a09888fba5 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Image pref 0:0:0 {{(pid=102213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 14:48:32.072032 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.virt.hardware [None req-9073fee1-ef6e-45f3-8799-73a09888fba5 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=102213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 14:48:32.082613 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-809deb9c-f423-4a6f-9de6-b31d50c39656 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] 10.222.0.49 "GET /compute/v2.1/servers/dac49498-274f-4b45-ac30-0523cf21ee74" status: 200 len: 1314 microversion: 2.1 time: 1.202558 May 12 14:48:32.086432 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 11/25] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:48:30 2022] GET /compute/v2.1/servers/dac49498-274f-4b45-ac30-0523cf21ee74 => generated 1314 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:48:32.100616 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-9073fee1-ef6e-45f3-8799-73a09888fba5 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:32.101283 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-9073fee1-ef6e-45f3-8799-73a09888fba5 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:32.102340 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-9073fee1-ef6e-45f3-8799-73a09888fba5 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:32.102903 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-9073fee1-ef6e-45f3-8799-73a09888fba5 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:32.217721 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.quota [None req-9073fee1-ef6e-45f3-8799-73a09888fba5 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Getting quotas for project 0301badcd92e4cc483246a0fa4949060. Resources: {'cores', 'ram', 'instances'} {{(pid=102213) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 12 14:48:32.232853 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.quota [None req-9073fee1-ef6e-45f3-8799-73a09888fba5 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Getting quotas for user ccce5e3f8320498ea48fa16c7d811ee1 and project 0301badcd92e4cc483246a0fa4949060. Resources: {'cores', 'ram', 'instances'} {{(pid=102213) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 12 14:48:32.264821 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-9073fee1-ef6e-45f3-8799-73a09888fba5 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Going to run 1 instances... {{(pid=102213) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 12 14:48:32.268212 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-9073fee1-ef6e-45f3-8799-73a09888fba5 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 2ce97f89-b3ca-43bc-95bb-fc748d173ed5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a4587ab2-5f51-46a3-a023-0e6778ccaaa1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=102213) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} May 12 14:48:32.553349 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-9073fee1-ef6e-45f3-8799-73a09888fba5 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.310191 May 12 14:48:32.554086 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 15/26] 10.222.0.49 () {60 vars in 1146 bytes} [Thu May 12 14:48:30 2022] POST /compute/v2.1/servers => generated 383 bytes in 2312 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 14:48:32.566327 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-d1ab9b59-7619-4ed2-8260-bb7adc1b6fd6 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:32.568258 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-d1ab9b59-7619-4ed2-8260-bb7adc1b6fd6 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 2ce97f89-b3ca-43bc-95bb-fc748d173ed5] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:48:32.949363 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-d1ab9b59-7619-4ed2-8260-bb7adc1b6fd6 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:48:32.964509 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-d1ab9b59-7619-4ed2-8260-bb7adc1b6fd6 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/2ce97f89-b3ca-43bc-95bb-fc748d173ed5" status: 200 len: 1222 microversion: 2.1 time: 0.400604 May 12 14:48:32.978528 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 12/27] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:48:32 2022] GET /compute/v2.1/servers/2ce97f89-b3ca-43bc-95bb-fc748d173ed5 => generated 1222 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:48:33.102214 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-94252734-53f7-437a-8822-588f8101ed1f tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:33.103943 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-94252734-53f7-437a-8822-588f8101ed1f tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] [instance: dac49498-274f-4b45-ac30-0523cf21ee74] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:48:33.131978 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-94252734-53f7-437a-8822-588f8101ed1f tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:33.138548 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-94252734-53f7-437a-8822-588f8101ed1f tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:33.142054 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-94252734-53f7-437a-8822-588f8101ed1f tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:33.143557 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-94252734-53f7-437a-8822-588f8101ed1f tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:33.392616 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-61a537b7-b4d3-4094-9471-edf4ec297558 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2128867064", "imageRef": "a4587ab2-5f51-46a3-a023-0e6778ccaaa1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "42e9462e-79bf-4236-9d9e-1261c021234a"}], "security_groups": [{"name": "tempest-securitygroup--1261056558"}], "key_name": "tempest-keypair-1676010479", "user_data": "}} {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:48:33.833201 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.network.neutron [None req-61a537b7-b4d3-4094-9471-edf4ec297558 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] validate_networks() for [('42e9462e-79bf-4236-9d9e-1261c021234a', None, None, None)] {{(pid=102212) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} May 12 14:48:34.594586 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-94252734-53f7-437a-8822-588f8101ed1f tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1458fa830b624a1cb64917dc815206ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0fc219e42a416ea2f81435544b43bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:48:34.620082 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-94252734-53f7-437a-8822-588f8101ed1f tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] 10.222.0.49 "GET /compute/v2.1/servers/dac49498-274f-4b45-ac30-0523cf21ee74" status: 200 len: 1314 microversion: 2.1 time: 1.521114 May 12 14:48:34.622777 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 16/28] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:48:33 2022] GET /compute/v2.1/servers/dac49498-274f-4b45-ac30-0523cf21ee74 => generated 1314 bytes in 1525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:48:34.654045 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-de0626a6-6dc1-4567-9fb8-55d96a2c8aae tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:34.658607 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-de0626a6-6dc1-4567-9fb8-55d96a2c8aae tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 2ce97f89-b3ca-43bc-95bb-fc748d173ed5] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:48:34.700544 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-de0626a6-6dc1-4567-9fb8-55d96a2c8aae tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:34.700996 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-de0626a6-6dc1-4567-9fb8-55d96a2c8aae tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:34.701958 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-de0626a6-6dc1-4567-9fb8-55d96a2c8aae tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:34.702458 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-de0626a6-6dc1-4567-9fb8-55d96a2c8aae tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:35.022154 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-de0626a6-6dc1-4567-9fb8-55d96a2c8aae tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:48:35.031666 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-de0626a6-6dc1-4567-9fb8-55d96a2c8aae tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/2ce97f89-b3ca-43bc-95bb-fc748d173ed5" status: 200 len: 1226 microversion: 2.1 time: 0.404151 May 12 14:48:35.035124 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 17/29] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:48:34 2022] GET /compute/v2.1/servers/2ce97f89-b3ca-43bc-95bb-fc748d173ed5 => generated 1226 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:48:35.639696 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-3767a1f5-9162-4d16-9d03-7ea1bfaf23a2 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:35.640499 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-3767a1f5-9162-4d16-9d03-7ea1bfaf23a2 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] [instance: dac49498-274f-4b45-ac30-0523cf21ee74] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:48:35.657052 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-3767a1f5-9162-4d16-9d03-7ea1bfaf23a2 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:35.657052 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-3767a1f5-9162-4d16-9d03-7ea1bfaf23a2 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:35.657052 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-3767a1f5-9162-4d16-9d03-7ea1bfaf23a2 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:35.657052 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-3767a1f5-9162-4d16-9d03-7ea1bfaf23a2 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:36.020931 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-3767a1f5-9162-4d16-9d03-7ea1bfaf23a2 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1458fa830b624a1cb64917dc815206ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0fc219e42a416ea2f81435544b43bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:48:36.030402 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.virt.hardware [None req-61a537b7-b4d3-4094-9471-edf4ec297558 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Flavor limits 0:0:0 {{(pid=102212) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 14:48:36.030964 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.virt.hardware [None req-61a537b7-b4d3-4094-9471-edf4ec297558 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Image limits 0:0:0 {{(pid=102212) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 14:48:36.031824 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.virt.hardware [None req-61a537b7-b4d3-4094-9471-edf4ec297558 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Flavor pref 0:0:0 {{(pid=102212) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 14:48:36.032332 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.virt.hardware [None req-61a537b7-b4d3-4094-9471-edf4ec297558 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Image pref 0:0:0 {{(pid=102212) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 14:48:36.032844 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.virt.hardware [None req-61a537b7-b4d3-4094-9471-edf4ec297558 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=102212) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 14:48:36.040299 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-3767a1f5-9162-4d16-9d03-7ea1bfaf23a2 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] 10.222.0.49 "GET /compute/v2.1/servers/dac49498-274f-4b45-ac30-0523cf21ee74" status: 200 len: 1314 microversion: 2.1 time: 0.403556 May 12 14:48:36.043283 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 18/30] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:48:35 2022] GET /compute/v2.1/servers/dac49498-274f-4b45-ac30-0523cf21ee74 => generated 1314 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:48:36.051102 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-61a537b7-b4d3-4094-9471-edf4ec297558 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:36.051973 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-61a537b7-b4d3-4094-9471-edf4ec297558 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:36.053401 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-61a537b7-b4d3-4094-9471-edf4ec297558 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:36.053401 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-61a537b7-b4d3-4094-9471-edf4ec297558 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:36.058834 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-f880448d-e58d-42e8-8216-bbabf6fb2798 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:36.061117 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-f880448d-e58d-42e8-8216-bbabf6fb2798 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 2ce97f89-b3ca-43bc-95bb-fc748d173ed5] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:48:36.074107 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-f880448d-e58d-42e8-8216-bbabf6fb2798 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:36.079018 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-f880448d-e58d-42e8-8216-bbabf6fb2798 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:36.079018 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-f880448d-e58d-42e8-8216-bbabf6fb2798 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:36.079018 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-f880448d-e58d-42e8-8216-bbabf6fb2798 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:36.079355 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.quota [None req-61a537b7-b4d3-4094-9471-edf4ec297558 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Getting quotas for project a090a68e336b4562aca524a95f550e04. Resources: {'cores', 'ram', 'instances'} {{(pid=102212) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 12 14:48:36.083119 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.quota [None req-61a537b7-b4d3-4094-9471-edf4ec297558 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Getting quotas for user b0e128ca83d6448c9ab1fe7dcc5467d4 and project a090a68e336b4562aca524a95f550e04. Resources: {'cores', 'ram', 'instances'} {{(pid=102212) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 12 14:48:36.094515 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-61a537b7-b4d3-4094-9471-edf4ec297558 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Going to run 1 instances... {{(pid=102212) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 12 14:48:36.097040 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-61a537b7-b4d3-4094-9471-edf4ec297558 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 3062e66d-4c2a-4212-b186-ecafec6bde2e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a4587ab2-5f51-46a3-a023-0e6778ccaaa1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=102212) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} May 12 14:48:36.280332 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-61a537b7-b4d3-4094-9471-edf4ec297558 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.891617 May 12 14:48:36.297362 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 13/31] 10.222.0.49 () {60 vars in 1146 bytes} [Thu May 12 14:48:33 2022] POST /compute/v2.1/servers => generated 402 bytes in 2909 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 12 14:48:36.302522 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-f880448d-e58d-42e8-8216-bbabf6fb2798 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:48:36.325432 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-dad7132f-df7a-4530-a324-c307cf648f5d tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:36.325432 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-dad7132f-df7a-4530-a324-c307cf648f5d tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 3062e66d-4c2a-4212-b186-ecafec6bde2e] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:48:36.326052 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-f880448d-e58d-42e8-8216-bbabf6fb2798 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/2ce97f89-b3ca-43bc-95bb-fc748d173ed5" status: 200 len: 1274 microversion: 2.1 time: 0.278484 May 12 14:48:36.327227 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 19/32] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:48:36 2022] GET /compute/v2.1/servers/2ce97f89-b3ca-43bc-95bb-fc748d173ed5 => generated 1274 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:48:36.551622 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-dad7132f-df7a-4530-a324-c307cf648f5d tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e128ca83d6448c9ab1fe7dcc5467d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a090a68e336b4562aca524a95f550e04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:48:36.592313 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-dad7132f-df7a-4530-a324-c307cf648f5d tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e" status: 200 len: 1238 microversion: 2.1 time: 0.291353 May 12 14:48:36.602696 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 14/33] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:48:36 2022] GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e => generated 1238 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:48:37.062489 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-c0d1b9bf-8089-4936-84ac-fd9e8ee6d32f tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:37.062489 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-c0d1b9bf-8089-4936-84ac-fd9e8ee6d32f tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] [instance: dac49498-274f-4b45-ac30-0523cf21ee74] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:48:37.068524 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-c0d1b9bf-8089-4936-84ac-fd9e8ee6d32f tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:37.069169 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-c0d1b9bf-8089-4936-84ac-fd9e8ee6d32f tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:37.070109 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-c0d1b9bf-8089-4936-84ac-fd9e8ee6d32f tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:37.070723 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-c0d1b9bf-8089-4936-84ac-fd9e8ee6d32f tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:37.343469 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-1253cc1d-da21-4dca-a355-225e1b58b842 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:37.344299 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-1253cc1d-da21-4dca-a355-225e1b58b842 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 2ce97f89-b3ca-43bc-95bb-fc748d173ed5] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:48:37.371897 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-1253cc1d-da21-4dca-a355-225e1b58b842 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:37.372502 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-1253cc1d-da21-4dca-a355-225e1b58b842 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:37.373596 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-1253cc1d-da21-4dca-a355-225e1b58b842 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:37.374142 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-1253cc1d-da21-4dca-a355-225e1b58b842 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:37.627186 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-1253cc1d-da21-4dca-a355-225e1b58b842 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:48:37.639650 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-1253cc1d-da21-4dca-a355-225e1b58b842 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/2ce97f89-b3ca-43bc-95bb-fc748d173ed5" status: 200 len: 1292 microversion: 2.1 time: 0.299928 May 12 14:48:37.641960 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 15/34] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:48:37 2022] GET /compute/v2.1/servers/2ce97f89-b3ca-43bc-95bb-fc748d173ed5 => generated 1292 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:48:37.656349 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-c0d1b9bf-8089-4936-84ac-fd9e8ee6d32f tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1458fa830b624a1cb64917dc815206ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0fc219e42a416ea2f81435544b43bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:48:37.668182 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-252dd011-a1a6-475e-aa9e-36256f482fd7 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:37.668988 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-c0d1b9bf-8089-4936-84ac-fd9e8ee6d32f tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] 10.222.0.49 "GET /compute/v2.1/servers/dac49498-274f-4b45-ac30-0523cf21ee74" status: 200 len: 1314 microversion: 2.1 time: 0.613511 May 12 14:48:37.669860 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 20/35] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:48:37 2022] GET /compute/v2.1/servers/dac49498-274f-4b45-ac30-0523cf21ee74 => generated 1314 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:48:37.679921 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-252dd011-a1a6-475e-aa9e-36256f482fd7 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 3062e66d-4c2a-4212-b186-ecafec6bde2e] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:48:37.772791 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-252dd011-a1a6-475e-aa9e-36256f482fd7 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e128ca83d6448c9ab1fe7dcc5467d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a090a68e336b4562aca524a95f550e04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:48:37.782503 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-252dd011-a1a6-475e-aa9e-36256f482fd7 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e" status: 200 len: 1238 microversion: 2.1 time: 0.139258 May 12 14:48:37.783454 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 16/36] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:48:37 2022] GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e => generated 1238 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:48:38.665761 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-f4847254-1756-43b2-8670-dee4825f033c tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:38.666439 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-f4847254-1756-43b2-8670-dee4825f033c tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 2ce97f89-b3ca-43bc-95bb-fc748d173ed5] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:48:38.683444 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-f4847254-1756-43b2-8670-dee4825f033c tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:38.684675 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-f4847254-1756-43b2-8670-dee4825f033c tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:38.686023 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-f4847254-1756-43b2-8670-dee4825f033c tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:38.686359 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-f4c161cf-07c2-489b-ac11-d53da18ad5c5 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:38.686836 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-f4847254-1756-43b2-8670-dee4825f033c tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:38.687596 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-f4c161cf-07c2-489b-ac11-d53da18ad5c5 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] [instance: dac49498-274f-4b45-ac30-0523cf21ee74] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:48:38.698509 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-f4c161cf-07c2-489b-ac11-d53da18ad5c5 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:38.705860 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-f4c161cf-07c2-489b-ac11-d53da18ad5c5 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:38.711306 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-f4c161cf-07c2-489b-ac11-d53da18ad5c5 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:38.711306 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-f4c161cf-07c2-489b-ac11-d53da18ad5c5 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:39.318606 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-f4c161cf-07c2-489b-ac11-d53da18ad5c5 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1458fa830b624a1cb64917dc815206ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0fc219e42a416ea2f81435544b43bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:48:39.329924 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-f4c161cf-07c2-489b-ac11-d53da18ad5c5 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] 10.222.0.49 "GET /compute/v2.1/servers/dac49498-274f-4b45-ac30-0523cf21ee74" status: 200 len: 1314 microversion: 2.1 time: 0.647898 May 12 14:48:39.340263 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 17/37] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:48:38 2022] GET /compute/v2.1/servers/dac49498-274f-4b45-ac30-0523cf21ee74 => generated 1314 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:48:39.378940 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-cc68db31-a2ef-4f98-b23e-a2a9d2818034 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:39.379929 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-cc68db31-a2ef-4f98-b23e-a2a9d2818034 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 3062e66d-4c2a-4212-b186-ecafec6bde2e] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:48:39.407480 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-cc68db31-a2ef-4f98-b23e-a2a9d2818034 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:39.411407 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-cc68db31-a2ef-4f98-b23e-a2a9d2818034 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:39.414976 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-cc68db31-a2ef-4f98-b23e-a2a9d2818034 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:39.415611 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-cc68db31-a2ef-4f98-b23e-a2a9d2818034 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:39.675950 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-cc68db31-a2ef-4f98-b23e-a2a9d2818034 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e128ca83d6448c9ab1fe7dcc5467d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a090a68e336b4562aca524a95f550e04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:48:39.688115 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-cc68db31-a2ef-4f98-b23e-a2a9d2818034 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e" status: 200 len: 1290 microversion: 2.1 time: 0.345724 May 12 14:48:39.689209 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 18/38] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:48:39 2022] GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e => generated 1290 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:48:39.828946 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-f4847254-1756-43b2-8670-dee4825f033c tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:48:39.837277 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-f4847254-1756-43b2-8670-dee4825f033c tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/2ce97f89-b3ca-43bc-95bb-fc748d173ed5" status: 200 len: 1322 microversion: 2.1 time: 1.180356 May 12 14:48:39.847706 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 21/39] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:48:38 2022] GET /compute/v2.1/servers/2ce97f89-b3ca-43bc-95bb-fc748d173ed5 => generated 1322 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:48:40.354982 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-5c920669-ee72-4eb8-98de-f99a04ef0230 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:40.356082 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-5c920669-ee72-4eb8-98de-f99a04ef0230 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] [instance: dac49498-274f-4b45-ac30-0523cf21ee74] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:48:40.370498 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-5c920669-ee72-4eb8-98de-f99a04ef0230 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:40.371269 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-5c920669-ee72-4eb8-98de-f99a04ef0230 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:40.372767 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-5c920669-ee72-4eb8-98de-f99a04ef0230 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:40.373542 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-5c920669-ee72-4eb8-98de-f99a04ef0230 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:40.544051 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-1a983c50-9f20-46a8-8120-e240d745271f tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-9515840", "imageRef": "a4587ab2-5f51-46a3-a023-0e6778ccaaa1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9862f13a-dccf-465d-abda-f29b2d232c04"}], "security_groups": [{"name": "tempest-securitygroup--1224993233"}], "key_name": "tempest-keypair-1319823142", "user_data": "}} {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:48:40.865478 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.network.neutron [None req-1a983c50-9f20-46a8-8120-e240d745271f tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] validate_networks() for [('9862f13a-dccf-465d-abda-f29b2d232c04', None, None, None)] {{(pid=102213) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} May 12 14:48:41.222596 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-5c920669-ee72-4eb8-98de-f99a04ef0230 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1458fa830b624a1cb64917dc815206ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0fc219e42a416ea2f81435544b43bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:48:41.239490 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-5c920669-ee72-4eb8-98de-f99a04ef0230 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] 10.222.0.49 "GET /compute/v2.1/servers/dac49498-274f-4b45-ac30-0523cf21ee74" status: 200 len: 1314 microversion: 2.1 time: 0.890091 May 12 14:48:41.248725 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 19/40] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:48:40 2022] GET /compute/v2.1/servers/dac49498-274f-4b45-ac30-0523cf21ee74 => generated 1314 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:48:41.269652 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [req-8423ced3-7e4d-48d5-8de6-c0128146af71 req-0b6c0b0a-5e4d-43b1-b1fc-738f0c80a3e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ce97f89-b3ca-43bc-95bb-fc748d173ed5", "tag": "358fc7eb-4380-4c2b-b14e-ae8fe0eb56fb"}]} {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:48:41.273453 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:48:41.273453 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: warnings.warn(msg) May 12 14:48:41.284505 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [req-8423ced3-7e4d-48d5-8de6-c0128146af71 req-0b6c0b0a-5e4d-43b1-b1fc-738f0c80a3e1 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:41.285472 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [req-8423ced3-7e4d-48d5-8de6-c0128146af71 req-0b6c0b0a-5e4d-43b1-b1fc-738f0c80a3e1 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:41.306129 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.compute.server_external_events [req-8423ced3-7e4d-48d5-8de6-c0128146af71 req-0b6c0b0a-5e4d-43b1-b1fc-738f0c80a3e1 service nova] Creating event network-changed:358fc7eb-4380-4c2b-b14e-ae8fe0eb56fb for instance 2ce97f89-b3ca-43bc-95bb-fc748d173ed5 on hv-cinder-83118 May 12 14:48:41.307629 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [req-8423ced3-7e4d-48d5-8de6-c0128146af71 req-0b6c0b0a-5e4d-43b1-b1fc-738f0c80a3e1 service nova] Acquired lock "compute-rpcapi-router" {{(pid=102212) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} May 12 14:48:41.308967 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-0a30db1f-5f49-4e18-9490-1b4ee7e040aa None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:41.309769 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-0a30db1f-5f49-4e18-9490-1b4ee7e040aa None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:41.310763 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-0a30db1f-5f49-4e18-9490-1b4ee7e040aa None None] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:41.311447 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-0a30db1f-5f49-4e18-9490-1b4ee7e040aa None None] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:41.323482 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.compute.rpcapi [None req-0a30db1f-5f49-4e18-9490-1b4ee7e040aa None None] Automatically selected compute RPC version 6.0 from minimum service version 56 May 12 14:48:41.325410 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-0a30db1f-5f49-4e18-9490-1b4ee7e040aa None None] Releasing lock "compute-rpcapi-router" {{(pid=102212) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} May 12 14:48:41.353735 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-0a30db1f-5f49-4e18-9490-1b4ee7e040aa None None] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099570 May 12 14:48:41.355575 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 20/41] 10.222.0.49 () {64 vars in 1317 bytes} [Thu May 12 14:48:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:48:41.362252 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-01c35914-0ad5-4a10-9911-1daea429b49c tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:41.362978 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-01c35914-0ad5-4a10-9911-1daea429b49c tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 3062e66d-4c2a-4212-b186-ecafec6bde2e] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:48:41.372399 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-01c35914-0ad5-4a10-9911-1daea429b49c tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:41.373094 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-01c35914-0ad5-4a10-9911-1daea429b49c tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:41.374379 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-01c35914-0ad5-4a10-9911-1daea429b49c tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:41.375538 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-01c35914-0ad5-4a10-9911-1daea429b49c tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:41.570757 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-01c35914-0ad5-4a10-9911-1daea429b49c tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e128ca83d6448c9ab1fe7dcc5467d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a090a68e336b4562aca524a95f550e04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:48:41.585676 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-01c35914-0ad5-4a10-9911-1daea429b49c tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e" status: 200 len: 1296 microversion: 2.1 time: 0.227648 May 12 14:48:41.590848 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 21/42] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:48:41 2022] GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e => generated 1296 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:48:41.594216 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-5f691d1c-795c-4903-b353-34a706ebdd29 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:41.595020 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-5f691d1c-795c-4903-b353-34a706ebdd29 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 2ce97f89-b3ca-43bc-95bb-fc748d173ed5] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:48:41.602561 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-5f691d1c-795c-4903-b353-34a706ebdd29 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:41.603345 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-5f691d1c-795c-4903-b353-34a706ebdd29 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:41.604261 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-5f691d1c-795c-4903-b353-34a706ebdd29 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:41.604802 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-5f691d1c-795c-4903-b353-34a706ebdd29 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:42.250343 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-5f691d1c-795c-4903-b353-34a706ebdd29 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:48:42.264735 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-5f691d1c-795c-4903-b353-34a706ebdd29 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/2ce97f89-b3ca-43bc-95bb-fc748d173ed5" status: 200 len: 1322 microversion: 2.1 time: 0.674834 May 12 14:48:42.264735 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 22/43] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:48:41 2022] GET /compute/v2.1/servers/2ce97f89-b3ca-43bc-95bb-fc748d173ed5 => generated 1322 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:48:42.390486 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [req-a16623b2-4c04-4cf5-93f9-e69aaa3fd56f req-10be660a-fef3-4bf3-88da-5b6202ab2f2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1", "tag": "e6f62ab3-f3da-45c1-adb2-4c7f5c9d2ff4"}]} {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:48:42.396558 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:48:42.396558 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: warnings.warn(msg) May 12 14:48:42.411109 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [req-a16623b2-4c04-4cf5-93f9-e69aaa3fd56f req-10be660a-fef3-4bf3-88da-5b6202ab2f2f service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:42.418332 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [req-a16623b2-4c04-4cf5-93f9-e69aaa3fd56f req-10be660a-fef3-4bf3-88da-5b6202ab2f2f service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:42.460815 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.compute.server_external_events [req-a16623b2-4c04-4cf5-93f9-e69aaa3fd56f req-10be660a-fef3-4bf3-88da-5b6202ab2f2f service nova] Creating event network-changed:e6f62ab3-f3da-45c1-adb2-4c7f5c9d2ff4 for instance d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1 on hv-cinder-83118 May 12 14:48:42.474828 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [req-a16623b2-4c04-4cf5-93f9-e69aaa3fd56f req-10be660a-fef3-4bf3-88da-5b6202ab2f2f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.209133 May 12 14:48:42.475580 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 23/44] 10.222.0.49 () {64 vars in 1317 bytes} [Thu May 12 14:48:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:48:42.488141 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-b7c82f07-55dc-4758-9e37-3005fe315db2 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:42.488867 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-b7c82f07-55dc-4758-9e37-3005fe315db2 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] [instance: dac49498-274f-4b45-ac30-0523cf21ee74] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:48:42.501254 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-b7c82f07-55dc-4758-9e37-3005fe315db2 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:42.501931 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-b7c82f07-55dc-4758-9e37-3005fe315db2 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:42.502946 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-b7c82f07-55dc-4758-9e37-3005fe315db2 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:42.503536 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-b7c82f07-55dc-4758-9e37-3005fe315db2 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:42.573806 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.virt.hardware [None req-1a983c50-9f20-46a8-8120-e240d745271f tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Flavor limits 0:0:0 {{(pid=102213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 14:48:42.576058 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.virt.hardware [None req-1a983c50-9f20-46a8-8120-e240d745271f tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Image limits 0:0:0 {{(pid=102213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 14:48:42.576562 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.virt.hardware [None req-1a983c50-9f20-46a8-8120-e240d745271f tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Flavor pref 0:0:0 {{(pid=102213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 14:48:42.576986 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.virt.hardware [None req-1a983c50-9f20-46a8-8120-e240d745271f tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Image pref 0:0:0 {{(pid=102213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 14:48:42.577405 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.virt.hardware [None req-1a983c50-9f20-46a8-8120-e240d745271f tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=102213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 14:48:42.595016 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-1a983c50-9f20-46a8-8120-e240d745271f tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:42.595471 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-1a983c50-9f20-46a8-8120-e240d745271f tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:42.596282 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-1a983c50-9f20-46a8-8120-e240d745271f tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:42.596723 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-1a983c50-9f20-46a8-8120-e240d745271f tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:42.618934 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.quota [None req-1a983c50-9f20-46a8-8120-e240d745271f tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Getting quotas for project 67a8451272cc41ebaf1598ed940bf09a. Resources: {'cores', 'ram', 'instances'} {{(pid=102213) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 12 14:48:42.626626 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.quota [None req-1a983c50-9f20-46a8-8120-e240d745271f tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Getting quotas for user 6a641a08648b454780081ecc2e291066 and project 67a8451272cc41ebaf1598ed940bf09a. Resources: {'cores', 'ram', 'instances'} {{(pid=102213) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 12 14:48:42.649280 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-1a983c50-9f20-46a8-8120-e240d745271f tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Going to run 1 instances... {{(pid=102213) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 12 14:48:42.652742 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-1a983c50-9f20-46a8-8120-e240d745271f tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a4587ab2-5f51-46a3-a023-0e6778ccaaa1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=102213) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} May 12 14:48:42.944947 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-1a983c50-9f20-46a8-8120-e240d745271f tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.405730 May 12 14:48:42.946593 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 22/45] 10.222.0.49 () {60 vars in 1146 bytes} [Thu May 12 14:48:40 2022] POST /compute/v2.1/servers => generated 402 bytes in 2408 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 12 14:48:43.091848 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-b7c82f07-55dc-4758-9e37-3005fe315db2 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1458fa830b624a1cb64917dc815206ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0fc219e42a416ea2f81435544b43bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:48:43.109346 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-b7c82f07-55dc-4758-9e37-3005fe315db2 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] 10.222.0.49 "GET /compute/v2.1/servers/dac49498-274f-4b45-ac30-0523cf21ee74" status: 200 len: 1314 microversion: 2.1 time: 0.631338 May 12 14:48:43.135609 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 24/46] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:48:42 2022] GET /compute/v2.1/servers/dac49498-274f-4b45-ac30-0523cf21ee74 => generated 1314 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:48:43.145262 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-4fb950b0-0cec-42e3-bed8-899a3d938c86 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:43.145262 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-4fb950b0-0cec-42e3-bed8-899a3d938c86 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 3062e66d-4c2a-4212-b186-ecafec6bde2e] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:48:43.173195 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-4fb950b0-0cec-42e3-bed8-899a3d938c86 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:43.173579 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-4fb950b0-0cec-42e3-bed8-899a3d938c86 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:43.174370 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-4fb950b0-0cec-42e3-bed8-899a3d938c86 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:43.174828 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-4fb950b0-0cec-42e3-bed8-899a3d938c86 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:43.226781 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [req-7d076b2b-872b-4630-a4b4-71afe4e32c4a req-8262bbb9-8329-458f-a1fb-e437d34670b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dac49498-274f-4b45-ac30-0523cf21ee74", "name": "network-vif-plugged", "status": "completed", "tag": "2044ac30-5708-42cb-b26e-840d25d8c8a6"}]} {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:48:43.228417 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:48:43.228417 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: warnings.warn(msg) May 12 14:48:43.239796 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [req-7d076b2b-872b-4630-a4b4-71afe4e32c4a req-8262bbb9-8329-458f-a1fb-e437d34670b9 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:43.249987 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [req-7d076b2b-872b-4630-a4b4-71afe4e32c4a req-8262bbb9-8329-458f-a1fb-e437d34670b9 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:43.297417 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.compute.server_external_events [req-7d076b2b-872b-4630-a4b4-71afe4e32c4a req-8262bbb9-8329-458f-a1fb-e437d34670b9 service nova] Creating event network-vif-plugged:2044ac30-5708-42cb-b26e-840d25d8c8a6 for instance dac49498-274f-4b45-ac30-0523cf21ee74 on hv-cinder-83118 May 12 14:48:43.306233 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [req-7d076b2b-872b-4630-a4b4-71afe4e32c4a req-8262bbb9-8329-458f-a1fb-e437d34670b9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.356102 May 12 14:48:43.319281 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 23/47] 10.222.0.49 () {64 vars in 1317 bytes} [Thu May 12 14:48:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:48:43.324698 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-a4d42cb1-bd92-44cc-9689-4ba19de9200b tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:43.330550 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-a4d42cb1-bd92-44cc-9689-4ba19de9200b tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:48:43.524192 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-a4d42cb1-bd92-44cc-9689-4ba19de9200b tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a641a08648b454780081ecc2e291066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a8451272cc41ebaf1598ed940bf09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:48:43.537071 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-a4d42cb1-bd92-44cc-9689-4ba19de9200b tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7" status: 200 len: 1239 microversion: 2.1 time: 0.216069 May 12 14:48:43.538240 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 24/48] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:48:43 2022] GET /compute/v2.1/servers/64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7 => generated 1239 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:48:43.553165 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-be473a6e-db0b-479a-9821-21ffbe7f928b tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:43.554361 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-be473a6e-db0b-479a-9821-21ffbe7f928b tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 2ce97f89-b3ca-43bc-95bb-fc748d173ed5] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:48:43.579787 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-be473a6e-db0b-479a-9821-21ffbe7f928b tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:43.581640 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-be473a6e-db0b-479a-9821-21ffbe7f928b tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:43.583061 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-be473a6e-db0b-479a-9821-21ffbe7f928b tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:43.583717 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-be473a6e-db0b-479a-9821-21ffbe7f928b tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:44.323105 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-be473a6e-db0b-479a-9821-21ffbe7f928b tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:48:44.332254 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-be473a6e-db0b-479a-9821-21ffbe7f928b tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/2ce97f89-b3ca-43bc-95bb-fc748d173ed5" status: 200 len: 1322 microversion: 2.1 time: 0.792464 May 12 14:48:44.332835 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 25/49] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:48:43 2022] GET /compute/v2.1/servers/2ce97f89-b3ca-43bc-95bb-fc748d173ed5 => generated 1322 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:48:44.337772 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-517aab30-1793-4c51-8c2b-ec7976b7104f tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:44.339142 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-517aab30-1793-4c51-8c2b-ec7976b7104f tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] [instance: dac49498-274f-4b45-ac30-0523cf21ee74] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:48:44.347078 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-517aab30-1793-4c51-8c2b-ec7976b7104f tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:44.347698 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-517aab30-1793-4c51-8c2b-ec7976b7104f tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:44.348642 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-517aab30-1793-4c51-8c2b-ec7976b7104f tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:44.349655 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-517aab30-1793-4c51-8c2b-ec7976b7104f tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:44.452649 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-4fb950b0-0cec-42e3-bed8-899a3d938c86 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e128ca83d6448c9ab1fe7dcc5467d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a090a68e336b4562aca524a95f550e04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:48:44.465472 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-4fb950b0-0cec-42e3-bed8-899a3d938c86 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e" status: 200 len: 1364 microversion: 2.1 time: 1.328711 May 12 14:48:44.466627 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 25/50] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:48:43 2022] GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e => generated 1364 bytes in 1330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:48:44.555348 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-05efc64a-0b36-49c1-8a0c-80c3c8d08371 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:44.556286 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-05efc64a-0b36-49c1-8a0c-80c3c8d08371 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:48:44.567750 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-05efc64a-0b36-49c1-8a0c-80c3c8d08371 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:44.570541 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-05efc64a-0b36-49c1-8a0c-80c3c8d08371 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:44.570541 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-05efc64a-0b36-49c1-8a0c-80c3c8d08371 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:44.570541 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-05efc64a-0b36-49c1-8a0c-80c3c8d08371 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:44.660211 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-517aab30-1793-4c51-8c2b-ec7976b7104f tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1458fa830b624a1cb64917dc815206ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0fc219e42a416ea2f81435544b43bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:48:44.671265 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-517aab30-1793-4c51-8c2b-ec7976b7104f tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] 10.222.0.49 "GET /compute/v2.1/servers/dac49498-274f-4b45-ac30-0523cf21ee74" status: 200 len: 1314 microversion: 2.1 time: 0.336278 May 12 14:48:44.678936 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 26/51] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:48:44 2022] GET /compute/v2.1/servers/dac49498-274f-4b45-ac30-0523cf21ee74 => generated 1314 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:48:44.699362 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-05efc64a-0b36-49c1-8a0c-80c3c8d08371 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a641a08648b454780081ecc2e291066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a8451272cc41ebaf1598ed940bf09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:48:44.709423 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-05efc64a-0b36-49c1-8a0c-80c3c8d08371 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7" status: 200 len: 1243 microversion: 2.1 time: 0.157609 May 12 14:48:44.719398 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 26/52] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:48:44 2022] GET /compute/v2.1/servers/64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7 => generated 1243 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:48:45.356172 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-bba119f3-c6f8-40ab-860f-b524d83508b7 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:45.356797 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-bba119f3-c6f8-40ab-860f-b524d83508b7 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 2ce97f89-b3ca-43bc-95bb-fc748d173ed5] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:48:45.364958 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [req-9ab27f62-99fc-4d4d-b6c6-18d461f963fa req-95bfefd0-c9e6-48ae-879b-7330eb2c1eee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3062e66d-4c2a-4212-b186-ecafec6bde2e", "tag": "dc63b69d-a47c-45f7-a4ec-c94b33fcef39"}]} {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:48:45.366527 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:48:45.366527 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: warnings.warn(msg) May 12 14:48:45.389292 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-bba119f3-c6f8-40ab-860f-b524d83508b7 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:45.389742 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-bba119f3-c6f8-40ab-860f-b524d83508b7 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:45.392576 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-bba119f3-c6f8-40ab-860f-b524d83508b7 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:45.393020 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-bba119f3-c6f8-40ab-860f-b524d83508b7 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:45.395461 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [req-9ab27f62-99fc-4d4d-b6c6-18d461f963fa req-95bfefd0-c9e6-48ae-879b-7330eb2c1eee service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:45.396276 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [req-9ab27f62-99fc-4d4d-b6c6-18d461f963fa req-95bfefd0-c9e6-48ae-879b-7330eb2c1eee service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:45.440209 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.compute.server_external_events [req-9ab27f62-99fc-4d4d-b6c6-18d461f963fa req-95bfefd0-c9e6-48ae-879b-7330eb2c1eee service nova] Creating event network-changed:dc63b69d-a47c-45f7-a4ec-c94b33fcef39 for instance 3062e66d-4c2a-4212-b186-ecafec6bde2e on hv-cinder-83118 May 12 14:48:45.445514 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [req-9ab27f62-99fc-4d4d-b6c6-18d461f963fa req-95bfefd0-c9e6-48ae-879b-7330eb2c1eee service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084347 May 12 14:48:45.446306 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 27/53] 10.222.0.49 () {64 vars in 1317 bytes} [Thu May 12 14:48:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 14:48:45.484577 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-1d741731-c2ad-4117-aa84-bb4303289f40 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:45.486206 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-1d741731-c2ad-4117-aa84-bb4303289f40 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 3062e66d-4c2a-4212-b186-ecafec6bde2e] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:48:45.498842 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-1d741731-c2ad-4117-aa84-bb4303289f40 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:45.499480 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-1d741731-c2ad-4117-aa84-bb4303289f40 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:45.500330 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-1d741731-c2ad-4117-aa84-bb4303289f40 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:45.500776 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-1d741731-c2ad-4117-aa84-bb4303289f40 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:45.673190 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-bba119f3-c6f8-40ab-860f-b524d83508b7 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:48:45.688142 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-bba119f3-c6f8-40ab-860f-b524d83508b7 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/2ce97f89-b3ca-43bc-95bb-fc748d173ed5" status: 200 len: 1322 microversion: 2.1 time: 0.338484 May 12 14:48:45.696603 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 27/54] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:48:45 2022] GET /compute/v2.1/servers/2ce97f89-b3ca-43bc-95bb-fc748d173ed5 => generated 1322 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:48:45.717419 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-fd129f63-d6af-4e83-b544-adee7fde52a7 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:45.718083 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-fd129f63-d6af-4e83-b544-adee7fde52a7 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] [instance: dac49498-274f-4b45-ac30-0523cf21ee74] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:48:45.726119 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-fd129f63-d6af-4e83-b544-adee7fde52a7 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:45.726578 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-fd129f63-d6af-4e83-b544-adee7fde52a7 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:45.727393 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-fd129f63-d6af-4e83-b544-adee7fde52a7 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:45.727837 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-fd129f63-d6af-4e83-b544-adee7fde52a7 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:45.790433 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-1d741731-c2ad-4117-aa84-bb4303289f40 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e128ca83d6448c9ab1fe7dcc5467d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a090a68e336b4562aca524a95f550e04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:48:45.799089 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-1d741731-c2ad-4117-aa84-bb4303289f40 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e" status: 200 len: 1364 microversion: 2.1 time: 0.318777 May 12 14:48:45.800339 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 28/55] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:48:45 2022] GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e => generated 1364 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:48:45.804665 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-d6c167a0-e96d-40c3-8af9-d90c2ac822f2 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:45.805733 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-d6c167a0-e96d-40c3-8af9-d90c2ac822f2 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:48:45.814112 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-d6c167a0-e96d-40c3-8af9-d90c2ac822f2 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:45.814831 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-d6c167a0-e96d-40c3-8af9-d90c2ac822f2 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:45.815644 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-d6c167a0-e96d-40c3-8af9-d90c2ac822f2 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:45.816088 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-d6c167a0-e96d-40c3-8af9-d90c2ac822f2 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:45.953587 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-d6c167a0-e96d-40c3-8af9-d90c2ac822f2 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a641a08648b454780081ecc2e291066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a8451272cc41ebaf1598ed940bf09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:48:45.961749 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-d6c167a0-e96d-40c3-8af9-d90c2ac822f2 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7" status: 200 len: 1243 microversion: 2.1 time: 0.160372 May 12 14:48:45.962626 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 29/56] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:48:45 2022] GET /compute/v2.1/servers/64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7 => generated 1243 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:48:45.989501 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-fd129f63-d6af-4e83-b544-adee7fde52a7 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1458fa830b624a1cb64917dc815206ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0fc219e42a416ea2f81435544b43bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:48:45.997575 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-fd129f63-d6af-4e83-b544-adee7fde52a7 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] 10.222.0.49 "GET /compute/v2.1/servers/dac49498-274f-4b45-ac30-0523cf21ee74" status: 200 len: 1314 microversion: 2.1 time: 0.287851 May 12 14:48:46.003552 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 28/57] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:48:45 2022] GET /compute/v2.1/servers/dac49498-274f-4b45-ac30-0523cf21ee74 => generated 1314 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:48:46.714233 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-3e223fb7-1f80-4779-89e3-6a01a7417ef2 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:46.714891 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-3e223fb7-1f80-4779-89e3-6a01a7417ef2 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 2ce97f89-b3ca-43bc-95bb-fc748d173ed5] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:48:46.722171 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-3e223fb7-1f80-4779-89e3-6a01a7417ef2 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:46.725315 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-3e223fb7-1f80-4779-89e3-6a01a7417ef2 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:46.725315 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-3e223fb7-1f80-4779-89e3-6a01a7417ef2 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:46.725315 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-3e223fb7-1f80-4779-89e3-6a01a7417ef2 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:46.816176 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-2ed317b8-1174-4bdc-a32d-1b3a7b02c049 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:46.816824 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-2ed317b8-1174-4bdc-a32d-1b3a7b02c049 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 3062e66d-4c2a-4212-b186-ecafec6bde2e] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:48:46.824805 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-2ed317b8-1174-4bdc-a32d-1b3a7b02c049 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:46.825268 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-2ed317b8-1174-4bdc-a32d-1b3a7b02c049 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:46.826047 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-2ed317b8-1174-4bdc-a32d-1b3a7b02c049 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:46.826485 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-2ed317b8-1174-4bdc-a32d-1b3a7b02c049 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:46.939563 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-3e223fb7-1f80-4779-89e3-6a01a7417ef2 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:48:46.955122 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-3e223fb7-1f80-4779-89e3-6a01a7417ef2 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/2ce97f89-b3ca-43bc-95bb-fc748d173ed5" status: 200 len: 1322 microversion: 2.1 time: 0.244875 May 12 14:48:46.956317 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 30/58] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:48:46 2022] GET /compute/v2.1/servers/2ce97f89-b3ca-43bc-95bb-fc748d173ed5 => generated 1322 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:48:46.982074 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-3d534797-246f-4aab-bbdc-4b33a048c042 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:46.982074 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-3d534797-246f-4aab-bbdc-4b33a048c042 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:48:46.988353 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-3d534797-246f-4aab-bbdc-4b33a048c042 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:46.988884 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-3d534797-246f-4aab-bbdc-4b33a048c042 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:46.989886 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-3d534797-246f-4aab-bbdc-4b33a048c042 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:46.990412 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-3d534797-246f-4aab-bbdc-4b33a048c042 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:47.155366 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-2ed317b8-1174-4bdc-a32d-1b3a7b02c049 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e128ca83d6448c9ab1fe7dcc5467d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a090a68e336b4562aca524a95f550e04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:48:47.166369 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-2ed317b8-1174-4bdc-a32d-1b3a7b02c049 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e" status: 200 len: 1364 microversion: 2.1 time: 0.353558 May 12 14:48:47.167633 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 29/59] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:48:46 2022] GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e => generated 1364 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:48:47.173334 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-26c4071a-03b8-404d-9bc2-959ecbc79199 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:47.175112 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-26c4071a-03b8-404d-9bc2-959ecbc79199 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] [instance: dac49498-274f-4b45-ac30-0523cf21ee74] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:48:47.189920 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-3d534797-246f-4aab-bbdc-4b33a048c042 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a641a08648b454780081ecc2e291066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a8451272cc41ebaf1598ed940bf09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:48:47.201936 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-3d534797-246f-4aab-bbdc-4b33a048c042 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7" status: 200 len: 1243 microversion: 2.1 time: 0.226824 May 12 14:48:47.212266 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 31/60] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:48:46 2022] GET /compute/v2.1/servers/64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7 => generated 1243 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:48:47.214602 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-26c4071a-03b8-404d-9bc2-959ecbc79199 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:47.215591 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-26c4071a-03b8-404d-9bc2-959ecbc79199 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:47.216593 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-26c4071a-03b8-404d-9bc2-959ecbc79199 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:47.218635 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-26c4071a-03b8-404d-9bc2-959ecbc79199 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:47.470423 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-26c4071a-03b8-404d-9bc2-959ecbc79199 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1458fa830b624a1cb64917dc815206ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0fc219e42a416ea2f81435544b43bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:48:47.478790 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-26c4071a-03b8-404d-9bc2-959ecbc79199 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] 10.222.0.49 "GET /compute/v2.1/servers/dac49498-274f-4b45-ac30-0523cf21ee74" status: 200 len: 1314 microversion: 2.1 time: 0.309523 May 12 14:48:47.479376 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 30/61] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:48:47 2022] GET /compute/v2.1/servers/dac49498-274f-4b45-ac30-0523cf21ee74 => generated 1314 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:48:47.971380 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-4f91cea9-d55c-4ddc-a067-e05bc0428e08 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:47.971991 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-4f91cea9-d55c-4ddc-a067-e05bc0428e08 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 2ce97f89-b3ca-43bc-95bb-fc748d173ed5] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:48:47.979618 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-4f91cea9-d55c-4ddc-a067-e05bc0428e08 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:47.980069 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-4f91cea9-d55c-4ddc-a067-e05bc0428e08 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:47.980828 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-4f91cea9-d55c-4ddc-a067-e05bc0428e08 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:47.981261 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-4f91cea9-d55c-4ddc-a067-e05bc0428e08 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:48.183915 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-26233ea6-878e-43bd-b653-5c3214dc78e6 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:48.190670 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-4f91cea9-d55c-4ddc-a067-e05bc0428e08 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:48:48.190907 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-26233ea6-878e-43bd-b653-5c3214dc78e6 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 3062e66d-4c2a-4212-b186-ecafec6bde2e] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:48:48.203896 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-4f91cea9-d55c-4ddc-a067-e05bc0428e08 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/2ce97f89-b3ca-43bc-95bb-fc748d173ed5" status: 200 len: 1322 microversion: 2.1 time: 0.236104 May 12 14:48:48.206720 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-26233ea6-878e-43bd-b653-5c3214dc78e6 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:48.207421 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 32/62] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:48:47 2022] GET /compute/v2.1/servers/2ce97f89-b3ca-43bc-95bb-fc748d173ed5 => generated 1322 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:48:48.207927 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-26233ea6-878e-43bd-b653-5c3214dc78e6 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:48.208741 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-26233ea6-878e-43bd-b653-5c3214dc78e6 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:48.209178 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-26233ea6-878e-43bd-b653-5c3214dc78e6 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:48.225165 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-147e80de-1d7d-4130-91a9-bd3e74447a5f tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:48.225785 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-147e80de-1d7d-4130-91a9-bd3e74447a5f tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:48:48.239300 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-147e80de-1d7d-4130-91a9-bd3e74447a5f tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:48.239778 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-147e80de-1d7d-4130-91a9-bd3e74447a5f tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:48.240610 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-147e80de-1d7d-4130-91a9-bd3e74447a5f tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:48.240942 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-147e80de-1d7d-4130-91a9-bd3e74447a5f tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:48.434579 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-147e80de-1d7d-4130-91a9-bd3e74447a5f tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a641a08648b454780081ecc2e291066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a8451272cc41ebaf1598ed940bf09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:48:48.447117 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-147e80de-1d7d-4130-91a9-bd3e74447a5f tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7" status: 200 len: 1235 microversion: 2.1 time: 0.225447 May 12 14:48:48.449944 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 33/63] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:48:48 2022] GET /compute/v2.1/servers/64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7 => generated 1235 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:48:48.496381 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-784f70c3-cd3f-4ecc-af22-39ae826702f7 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:48.497216 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-784f70c3-cd3f-4ecc-af22-39ae826702f7 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] [instance: dac49498-274f-4b45-ac30-0523cf21ee74] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:48:48.505651 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-784f70c3-cd3f-4ecc-af22-39ae826702f7 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:48.506307 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-784f70c3-cd3f-4ecc-af22-39ae826702f7 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:48.507267 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-784f70c3-cd3f-4ecc-af22-39ae826702f7 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:48.507848 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-784f70c3-cd3f-4ecc-af22-39ae826702f7 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:48.541167 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-26233ea6-878e-43bd-b653-5c3214dc78e6 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e128ca83d6448c9ab1fe7dcc5467d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a090a68e336b4562aca524a95f550e04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:48:48.550644 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-26233ea6-878e-43bd-b653-5c3214dc78e6 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e" status: 200 len: 1364 microversion: 2.1 time: 0.370503 May 12 14:48:48.551252 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 31/64] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:48:48 2022] GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e => generated 1364 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:48:48.735159 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-784f70c3-cd3f-4ecc-af22-39ae826702f7 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1458fa830b624a1cb64917dc815206ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0fc219e42a416ea2f81435544b43bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:48:48.744547 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-784f70c3-cd3f-4ecc-af22-39ae826702f7 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] 10.222.0.49 "GET /compute/v2.1/servers/dac49498-274f-4b45-ac30-0523cf21ee74" status: 200 len: 1314 microversion: 2.1 time: 0.252126 May 12 14:48:48.745117 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 34/65] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:48:48 2022] GET /compute/v2.1/servers/dac49498-274f-4b45-ac30-0523cf21ee74 => generated 1314 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:48:49.220798 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-03a3910e-2c41-4342-861c-34e2bc6166ef tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:49.221421 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-03a3910e-2c41-4342-861c-34e2bc6166ef tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 2ce97f89-b3ca-43bc-95bb-fc748d173ed5] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:48:49.229191 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-03a3910e-2c41-4342-861c-34e2bc6166ef tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:49.229646 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-03a3910e-2c41-4342-861c-34e2bc6166ef tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:49.232456 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-03a3910e-2c41-4342-861c-34e2bc6166ef tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:49.232456 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-03a3910e-2c41-4342-861c-34e2bc6166ef tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:49.430348 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-03a3910e-2c41-4342-861c-34e2bc6166ef tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:48:49.439214 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-03a3910e-2c41-4342-861c-34e2bc6166ef tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/2ce97f89-b3ca-43bc-95bb-fc748d173ed5" status: 200 len: 1322 microversion: 2.1 time: 0.222060 May 12 14:48:49.439774 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 32/66] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:48:49 2022] GET /compute/v2.1/servers/2ce97f89-b3ca-43bc-95bb-fc748d173ed5 => generated 1322 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:48:49.466174 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-12940023-1603-4e2a-a2b8-b2008612edc1 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:49.466807 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-12940023-1603-4e2a-a2b8-b2008612edc1 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:48:49.473961 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-12940023-1603-4e2a-a2b8-b2008612edc1 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:49.474413 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-12940023-1603-4e2a-a2b8-b2008612edc1 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:49.475227 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-12940023-1603-4e2a-a2b8-b2008612edc1 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:49.475661 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-12940023-1603-4e2a-a2b8-b2008612edc1 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:49.567590 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-c16fb9e6-55da-4f42-9f43-7a1e22690253 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:49.568130 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-c16fb9e6-55da-4f42-9f43-7a1e22690253 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 3062e66d-4c2a-4212-b186-ecafec6bde2e] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:48:49.575386 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-c16fb9e6-55da-4f42-9f43-7a1e22690253 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:49.575839 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-c16fb9e6-55da-4f42-9f43-7a1e22690253 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:49.576601 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-c16fb9e6-55da-4f42-9f43-7a1e22690253 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:49.577045 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-c16fb9e6-55da-4f42-9f43-7a1e22690253 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:49.585829 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-12940023-1603-4e2a-a2b8-b2008612edc1 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a641a08648b454780081ecc2e291066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a8451272cc41ebaf1598ed940bf09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:48:49.594790 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-12940023-1603-4e2a-a2b8-b2008612edc1 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7" status: 200 len: 1235 microversion: 2.1 time: 0.132289 May 12 14:48:49.595387 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 35/67] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:48:49 2022] GET /compute/v2.1/servers/64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7 => generated 1235 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:48:49.762000 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-24073297-bc0f-48ed-9239-5d19a6b6ee7d tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:49.762797 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-24073297-bc0f-48ed-9239-5d19a6b6ee7d tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] [instance: dac49498-274f-4b45-ac30-0523cf21ee74] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:48:49.768318 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-c16fb9e6-55da-4f42-9f43-7a1e22690253 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e128ca83d6448c9ab1fe7dcc5467d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a090a68e336b4562aca524a95f550e04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:48:49.770122 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-24073297-bc0f-48ed-9239-5d19a6b6ee7d tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:49.770707 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-24073297-bc0f-48ed-9239-5d19a6b6ee7d tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:49.771389 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-24073297-bc0f-48ed-9239-5d19a6b6ee7d tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:49.771918 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-24073297-bc0f-48ed-9239-5d19a6b6ee7d tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:49.776865 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-c16fb9e6-55da-4f42-9f43-7a1e22690253 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e" status: 200 len: 1364 microversion: 2.1 time: 0.213028 May 12 14:48:49.777497 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 33/68] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:48:49 2022] GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e => generated 1364 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:48:50.071844 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-24073297-bc0f-48ed-9239-5d19a6b6ee7d tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1458fa830b624a1cb64917dc815206ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0fc219e42a416ea2f81435544b43bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:48:50.083095 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-24073297-bc0f-48ed-9239-5d19a6b6ee7d tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] 10.222.0.49 "GET /compute/v2.1/servers/dac49498-274f-4b45-ac30-0523cf21ee74" status: 200 len: 1314 microversion: 2.1 time: 0.325404 May 12 14:48:50.083729 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 36/69] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:48:49 2022] GET /compute/v2.1/servers/dac49498-274f-4b45-ac30-0523cf21ee74 => generated 1314 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:48:50.455852 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-9b3d5812-3d80-4458-b292-bf6978597e40 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:50.456456 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-9b3d5812-3d80-4458-b292-bf6978597e40 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 2ce97f89-b3ca-43bc-95bb-fc748d173ed5] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:48:50.463783 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-9b3d5812-3d80-4458-b292-bf6978597e40 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:50.464226 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-9b3d5812-3d80-4458-b292-bf6978597e40 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:50.464984 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-9b3d5812-3d80-4458-b292-bf6978597e40 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:50.465413 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-9b3d5812-3d80-4458-b292-bf6978597e40 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:50.612790 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-47ff560f-7503-4618-a9e4-975c1b42a59a tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:50.616568 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-47ff560f-7503-4618-a9e4-975c1b42a59a tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:48:50.639588 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-47ff560f-7503-4618-a9e4-975c1b42a59a tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:50.639588 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-47ff560f-7503-4618-a9e4-975c1b42a59a tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:50.640280 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-47ff560f-7503-4618-a9e4-975c1b42a59a tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:50.640720 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-47ff560f-7503-4618-a9e4-975c1b42a59a tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:50.705768 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-9b3d5812-3d80-4458-b292-bf6978597e40 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:48:50.714531 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-9b3d5812-3d80-4458-b292-bf6978597e40 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/2ce97f89-b3ca-43bc-95bb-fc748d173ed5" status: 200 len: 1322 microversion: 2.1 time: 0.262363 May 12 14:48:50.715134 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 34/70] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:48:50 2022] GET /compute/v2.1/servers/2ce97f89-b3ca-43bc-95bb-fc748d173ed5 => generated 1322 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:48:50.794048 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-e1797d51-6b2b-4efa-946f-28fe6c869354 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:50.794672 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-e1797d51-6b2b-4efa-946f-28fe6c869354 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 3062e66d-4c2a-4212-b186-ecafec6bde2e] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:48:50.801947 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e1797d51-6b2b-4efa-946f-28fe6c869354 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:50.802468 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e1797d51-6b2b-4efa-946f-28fe6c869354 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:50.803269 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e1797d51-6b2b-4efa-946f-28fe6c869354 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:50.803700 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e1797d51-6b2b-4efa-946f-28fe6c869354 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:50.830225 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-47ff560f-7503-4618-a9e4-975c1b42a59a tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a641a08648b454780081ecc2e291066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a8451272cc41ebaf1598ed940bf09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:48:50.839444 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-47ff560f-7503-4618-a9e4-975c1b42a59a tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7" status: 200 len: 1291 microversion: 2.1 time: 0.231065 May 12 14:48:50.839983 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 37/71] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:48:50 2022] GET /compute/v2.1/servers/64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7 => generated 1291 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:48:51.019480 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-e1797d51-6b2b-4efa-946f-28fe6c869354 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e128ca83d6448c9ab1fe7dcc5467d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a090a68e336b4562aca524a95f550e04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:48:51.029624 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-e1797d51-6b2b-4efa-946f-28fe6c869354 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e" status: 200 len: 1364 microversion: 2.1 time: 0.239660 May 12 14:48:51.030901 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 35/72] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:48:50 2022] GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e => generated 1364 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:48:51.103642 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-46f6b590-5bb6-445c-88ea-abeb32f0bb8f tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:51.104279 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-46f6b590-5bb6-445c-88ea-abeb32f0bb8f tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] [instance: dac49498-274f-4b45-ac30-0523cf21ee74] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:48:51.117290 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-46f6b590-5bb6-445c-88ea-abeb32f0bb8f tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:51.117290 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-46f6b590-5bb6-445c-88ea-abeb32f0bb8f tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:51.117290 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-46f6b590-5bb6-445c-88ea-abeb32f0bb8f tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:51.117290 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-46f6b590-5bb6-445c-88ea-abeb32f0bb8f tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:51.733916 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-5f9e17e0-d095-4c4b-ad64-c6206dae132f tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:51.739517 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-5f9e17e0-d095-4c4b-ad64-c6206dae132f tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 2ce97f89-b3ca-43bc-95bb-fc748d173ed5] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:48:51.750686 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-5f9e17e0-d095-4c4b-ad64-c6206dae132f tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:51.751183 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-5f9e17e0-d095-4c4b-ad64-c6206dae132f tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:51.752291 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-5f9e17e0-d095-4c4b-ad64-c6206dae132f tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:51.752710 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-5f9e17e0-d095-4c4b-ad64-c6206dae132f tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:51.940528 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-46f6b590-5bb6-445c-88ea-abeb32f0bb8f tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1458fa830b624a1cb64917dc815206ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0fc219e42a416ea2f81435544b43bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:48:51.949596 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-46f6b590-5bb6-445c-88ea-abeb32f0bb8f tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] 10.222.0.49 "GET /compute/v2.1/servers/dac49498-274f-4b45-ac30-0523cf21ee74" status: 200 len: 1314 microversion: 2.1 time: 0.852398 May 12 14:48:51.966159 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 38/73] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:48:51 2022] GET /compute/v2.1/servers/dac49498-274f-4b45-ac30-0523cf21ee74 => generated 1314 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:48:51.970901 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-4f92f852-b4bb-465d-b71e-1d4e9ccb36c5 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:51.972953 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-4f92f852-b4bb-465d-b71e-1d4e9ccb36c5 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:48:52.008164 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-4f92f852-b4bb-465d-b71e-1d4e9ccb36c5 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:52.008961 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-4f92f852-b4bb-465d-b71e-1d4e9ccb36c5 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:52.017374 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-4f92f852-b4bb-465d-b71e-1d4e9ccb36c5 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:52.018197 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-4f92f852-b4bb-465d-b71e-1d4e9ccb36c5 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:52.044810 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-5f9e17e0-d095-4c4b-ad64-c6206dae132f tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:48:52.060814 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-5f9e17e0-d095-4c4b-ad64-c6206dae132f tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/2ce97f89-b3ca-43bc-95bb-fc748d173ed5" status: 200 len: 1322 microversion: 2.1 time: 0.328415 May 12 14:48:52.060814 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 36/74] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:48:51 2022] GET /compute/v2.1/servers/2ce97f89-b3ca-43bc-95bb-fc748d173ed5 => generated 1322 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:48:52.066336 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-d7d3f1fc-f8ce-4af7-ab79-6fe70369a078 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:52.067639 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-d7d3f1fc-f8ce-4af7-ab79-6fe70369a078 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 3062e66d-4c2a-4212-b186-ecafec6bde2e] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:48:52.078534 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-d7d3f1fc-f8ce-4af7-ab79-6fe70369a078 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:52.079274 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-d7d3f1fc-f8ce-4af7-ab79-6fe70369a078 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:52.080440 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-d7d3f1fc-f8ce-4af7-ab79-6fe70369a078 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:52.081174 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-d7d3f1fc-f8ce-4af7-ab79-6fe70369a078 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:52.460865 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-4f92f852-b4bb-465d-b71e-1d4e9ccb36c5 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a641a08648b454780081ecc2e291066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a8451272cc41ebaf1598ed940bf09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:48:52.476726 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-4f92f852-b4bb-465d-b71e-1d4e9ccb36c5 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7" status: 200 len: 1299 microversion: 2.1 time: 0.507826 May 12 14:48:52.476726 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 39/75] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:48:51 2022] GET /compute/v2.1/servers/64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7 => generated 1299 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:48:52.540021 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-d7d3f1fc-f8ce-4af7-ab79-6fe70369a078 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e128ca83d6448c9ab1fe7dcc5467d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a090a68e336b4562aca524a95f550e04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:48:52.553539 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-d7d3f1fc-f8ce-4af7-ab79-6fe70369a078 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e" status: 200 len: 1364 microversion: 2.1 time: 0.492670 May 12 14:48:52.554915 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 37/76] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:48:52 2022] GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e => generated 1364 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:48:52.767575 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [req-5dc19fa4-4daf-4108-b552-2e323bfa9854 req-2cb38dca-9a10-4e72-955d-ee748e507bf5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ce97f89-b3ca-43bc-95bb-fc748d173ed5", "name": "network-vif-plugged", "status": "completed", "tag": "358fc7eb-4380-4c2b-b14e-ae8fe0eb56fb"}]} {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:48:52.769208 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:48:52.769208 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: warnings.warn(msg) May 12 14:48:52.777591 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [req-5dc19fa4-4daf-4108-b552-2e323bfa9854 req-2cb38dca-9a10-4e72-955d-ee748e507bf5 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:52.778035 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [req-5dc19fa4-4daf-4108-b552-2e323bfa9854 req-2cb38dca-9a10-4e72-955d-ee748e507bf5 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:52.794006 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.compute.server_external_events [req-5dc19fa4-4daf-4108-b552-2e323bfa9854 req-2cb38dca-9a10-4e72-955d-ee748e507bf5 service nova] Creating event network-vif-plugged:358fc7eb-4380-4c2b-b14e-ae8fe0eb56fb for instance 2ce97f89-b3ca-43bc-95bb-fc748d173ed5 on hv-cinder-83118 May 12 14:48:52.799591 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [req-5dc19fa4-4daf-4108-b552-2e323bfa9854 req-2cb38dca-9a10-4e72-955d-ee748e507bf5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035505 May 12 14:48:52.800221 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 40/77] 10.222.0.49 () {64 vars in 1317 bytes} [Thu May 12 14:48:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:48:52.971991 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-40b61546-b859-4a92-a37f-6b4b13ad2e9c tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:52.973234 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-40b61546-b859-4a92-a37f-6b4b13ad2e9c tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] [instance: dac49498-274f-4b45-ac30-0523cf21ee74] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:48:52.981746 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-40b61546-b859-4a92-a37f-6b4b13ad2e9c tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:52.982197 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-40b61546-b859-4a92-a37f-6b4b13ad2e9c tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:52.983063 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-40b61546-b859-4a92-a37f-6b4b13ad2e9c tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:52.983559 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-40b61546-b859-4a92-a37f-6b4b13ad2e9c tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:53.075543 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-e3985a11-45a8-4646-8705-42852f2fd0fe tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:53.077101 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-e3985a11-45a8-4646-8705-42852f2fd0fe tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 2ce97f89-b3ca-43bc-95bb-fc748d173ed5] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:48:53.087920 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-e3985a11-45a8-4646-8705-42852f2fd0fe tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:53.088373 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-e3985a11-45a8-4646-8705-42852f2fd0fe tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:53.089371 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-e3985a11-45a8-4646-8705-42852f2fd0fe tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:53.089975 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-e3985a11-45a8-4646-8705-42852f2fd0fe tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:53.189584 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-40b61546-b859-4a92-a37f-6b4b13ad2e9c tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1458fa830b624a1cb64917dc815206ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0fc219e42a416ea2f81435544b43bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:48:53.200491 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-40b61546-b859-4a92-a37f-6b4b13ad2e9c tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] 10.222.0.49 "GET /compute/v2.1/servers/dac49498-274f-4b45-ac30-0523cf21ee74" status: 200 len: 1502 microversion: 2.1 time: 0.232430 May 12 14:48:53.216210 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 38/78] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:48:52 2022] GET /compute/v2.1/servers/dac49498-274f-4b45-ac30-0523cf21ee74 => generated 1502 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:48:53.492965 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-f947c8df-6822-4ba0-95da-06f96a2e41b5 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:53.493796 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-f947c8df-6822-4ba0-95da-06f96a2e41b5 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:48:53.501662 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-f947c8df-6822-4ba0-95da-06f96a2e41b5 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:53.502313 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-f947c8df-6822-4ba0-95da-06f96a2e41b5 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:53.503121 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-f947c8df-6822-4ba0-95da-06f96a2e41b5 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:53.510879 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-f947c8df-6822-4ba0-95da-06f96a2e41b5 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:53.589556 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-e3985a11-45a8-4646-8705-42852f2fd0fe tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:48:53.599972 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-e3985a11-45a8-4646-8705-42852f2fd0fe tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/2ce97f89-b3ca-43bc-95bb-fc748d173ed5" status: 200 len: 1322 microversion: 2.1 time: 0.529113 May 12 14:48:53.609388 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 41/79] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:48:53 2022] GET /compute/v2.1/servers/2ce97f89-b3ca-43bc-95bb-fc748d173ed5 => generated 1322 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:48:53.614413 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-343f9e8c-9f1a-4f5b-9850-c7aec3a07424 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:53.619860 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-343f9e8c-9f1a-4f5b-9850-c7aec3a07424 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 3062e66d-4c2a-4212-b186-ecafec6bde2e] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:48:53.623105 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-343f9e8c-9f1a-4f5b-9850-c7aec3a07424 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:53.623349 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-f947c8df-6822-4ba0-95da-06f96a2e41b5 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a641a08648b454780081ecc2e291066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a8451272cc41ebaf1598ed940bf09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:48:53.623691 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-343f9e8c-9f1a-4f5b-9850-c7aec3a07424 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:53.624622 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-343f9e8c-9f1a-4f5b-9850-c7aec3a07424 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:53.625126 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-343f9e8c-9f1a-4f5b-9850-c7aec3a07424 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:53.631586 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-f947c8df-6822-4ba0-95da-06f96a2e41b5 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7" status: 200 len: 1297 microversion: 2.1 time: 0.142303 May 12 14:48:53.632161 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 39/80] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:48:53 2022] GET /compute/v2.1/servers/64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7 => generated 1297 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:48:53.997999 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-343f9e8c-9f1a-4f5b-9850-c7aec3a07424 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e128ca83d6448c9ab1fe7dcc5467d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a090a68e336b4562aca524a95f550e04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:48:54.010383 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-343f9e8c-9f1a-4f5b-9850-c7aec3a07424 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e" status: 200 len: 1364 microversion: 2.1 time: 0.401183 May 12 14:48:54.010997 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 42/81] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:48:53 2022] GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e => generated 1364 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:48:54.617111 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-a0a82dfd-4a1d-4418-a78d-24c333565bd5 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:54.617727 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-a0a82dfd-4a1d-4418-a78d-24c333565bd5 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 2ce97f89-b3ca-43bc-95bb-fc748d173ed5] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:48:54.644504 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-a0a82dfd-4a1d-4418-a78d-24c333565bd5 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:54.644504 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-a0a82dfd-4a1d-4418-a78d-24c333565bd5 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:54.649253 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-ef3a175d-1123-4bc5-8b42-99f63e190823 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:54.649902 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-ef3a175d-1123-4bc5-8b42-99f63e190823 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:48:54.651860 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-a0a82dfd-4a1d-4418-a78d-24c333565bd5 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:54.652337 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-a0a82dfd-4a1d-4418-a78d-24c333565bd5 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:54.677882 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-ef3a175d-1123-4bc5-8b42-99f63e190823 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:54.678357 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-ef3a175d-1123-4bc5-8b42-99f63e190823 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:54.679188 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-ef3a175d-1123-4bc5-8b42-99f63e190823 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:54.679624 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-ef3a175d-1123-4bc5-8b42-99f63e190823 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:55.045146 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-a0a82dfd-4a1d-4418-a78d-24c333565bd5 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:48:55.063061 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-a0a82dfd-4a1d-4418-a78d-24c333565bd5 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/2ce97f89-b3ca-43bc-95bb-fc748d173ed5" status: 200 len: 1322 microversion: 2.1 time: 0.449548 May 12 14:48:55.063902 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 40/82] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:48:54 2022] GET /compute/v2.1/servers/2ce97f89-b3ca-43bc-95bb-fc748d173ed5 => generated 1322 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:48:55.068607 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [req-2e077c64-8be8-4a58-94d5-5dc932593c8b req-aed44be4-3d4e-46f6-b9b8-bad95722432b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1", "name": "network-vif-plugged", "status": "completed", "tag": "e6f62ab3-f3da-45c1-adb2-4c7f5c9d2ff4"}]} {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:48:55.070212 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:48:55.070212 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: warnings.warn(msg) May 12 14:48:55.079078 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [req-2e077c64-8be8-4a58-94d5-5dc932593c8b req-aed44be4-3d4e-46f6-b9b8-bad95722432b service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:55.079792 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [req-2e077c64-8be8-4a58-94d5-5dc932593c8b req-aed44be4-3d4e-46f6-b9b8-bad95722432b service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:55.111742 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.compute.server_external_events [req-2e077c64-8be8-4a58-94d5-5dc932593c8b req-aed44be4-3d4e-46f6-b9b8-bad95722432b service nova] Creating event network-vif-plugged:e6f62ab3-f3da-45c1-adb2-4c7f5c9d2ff4 for instance d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1 on hv-cinder-83118 May 12 14:48:55.128852 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [req-2e077c64-8be8-4a58-94d5-5dc932593c8b req-aed44be4-3d4e-46f6-b9b8-bad95722432b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063215 May 12 14:48:55.130964 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 41/83] 10.222.0.49 () {64 vars in 1317 bytes} [Thu May 12 14:48:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:48:55.143274 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-cac17ec0-7fe1-4677-b553-dd2cc420533a tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:55.148518 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-cac17ec0-7fe1-4677-b553-dd2cc420533a tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 3062e66d-4c2a-4212-b186-ecafec6bde2e] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:48:55.169550 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-cac17ec0-7fe1-4677-b553-dd2cc420533a tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:55.170683 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-cac17ec0-7fe1-4677-b553-dd2cc420533a tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:55.172734 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-cac17ec0-7fe1-4677-b553-dd2cc420533a tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:55.174257 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-cac17ec0-7fe1-4677-b553-dd2cc420533a tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:55.621588 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-cac17ec0-7fe1-4677-b553-dd2cc420533a tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e128ca83d6448c9ab1fe7dcc5467d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a090a68e336b4562aca524a95f550e04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:48:55.630238 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-cac17ec0-7fe1-4677-b553-dd2cc420533a tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e" status: 200 len: 1364 microversion: 2.1 time: 0.496216 May 12 14:48:55.630837 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 42/84] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:48:55 2022] GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e => generated 1364 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:48:55.636024 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-388cff29-92a9-4491-8f4c-53de4f77e2f9 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "69c023cd-e9f6-4e81-ba24-aefafd8f3d71"}} {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:48:55.637091 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-388cff29-92a9-4491-8f4c-53de4f77e2f9 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] [instance: dac49498-274f-4b45-ac30-0523cf21ee74] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:48:55.644740 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-388cff29-92a9-4491-8f4c-53de4f77e2f9 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:55.645195 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-388cff29-92a9-4491-8f4c-53de4f77e2f9 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:55.646090 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-388cff29-92a9-4491-8f4c-53de4f77e2f9 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:55.646545 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-388cff29-92a9-4491-8f4c-53de4f77e2f9 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:55.853411 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-ef3a175d-1123-4bc5-8b42-99f63e190823 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a641a08648b454780081ecc2e291066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a8451272cc41ebaf1598ed940bf09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:48:55.863489 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-ef3a175d-1123-4bc5-8b42-99f63e190823 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7" status: 200 len: 1365 microversion: 2.1 time: 1.217693 May 12 14:48:55.864070 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 43/85] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:48:54 2022] GET /compute/v2.1/servers/64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7 => generated 1365 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:48:56.016242 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [req-f3afab41-2aea-4304-9954-db0218ceafdb req-c68dd248-e44c-4dae-91a6-9e1fbdf343aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7", "tag": "b9ae57f3-8cbe-4bb3-80d3-db854a810952"}]} {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:48:56.018174 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:48:56.018174 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: warnings.warn(msg) May 12 14:48:56.035495 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [req-f3afab41-2aea-4304-9954-db0218ceafdb req-c68dd248-e44c-4dae-91a6-9e1fbdf343aa service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:56.035495 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [req-f3afab41-2aea-4304-9954-db0218ceafdb req-c68dd248-e44c-4dae-91a6-9e1fbdf343aa service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:56.052149 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.compute.server_external_events [req-f3afab41-2aea-4304-9954-db0218ceafdb req-c68dd248-e44c-4dae-91a6-9e1fbdf343aa service nova] Creating event network-changed:b9ae57f3-8cbe-4bb3-80d3-db854a810952 for instance 64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7 on hv-cinder-83118 May 12 14:48:56.059149 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [req-f3afab41-2aea-4304-9954-db0218ceafdb req-c68dd248-e44c-4dae-91a6-9e1fbdf343aa service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047230 May 12 14:48:56.059838 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 44/86] 10.222.0.49 () {64 vars in 1317 bytes} [Thu May 12 14:48:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:48:56.080657 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-29532a8d-9a2b-4e5f-a955-464746584efc tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:56.081523 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-29532a8d-9a2b-4e5f-a955-464746584efc tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 2ce97f89-b3ca-43bc-95bb-fc748d173ed5] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:48:56.089581 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-29532a8d-9a2b-4e5f-a955-464746584efc tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:56.095103 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-29532a8d-9a2b-4e5f-a955-464746584efc tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:56.095103 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-29532a8d-9a2b-4e5f-a955-464746584efc tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:56.095103 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-29532a8d-9a2b-4e5f-a955-464746584efc tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:56.348673 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-29532a8d-9a2b-4e5f-a955-464746584efc tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:48:56.357337 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-29532a8d-9a2b-4e5f-a955-464746584efc tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/2ce97f89-b3ca-43bc-95bb-fc748d173ed5" status: 200 len: 1515 microversion: 2.1 time: 0.281209 May 12 14:48:56.362689 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 45/87] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:48:56 2022] GET /compute/v2.1/servers/2ce97f89-b3ca-43bc-95bb-fc748d173ed5 => generated 1515 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:48:56.373586 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-02141712-7dde-476c-8c5c-1533ad4dd4c4 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:48:56.374619 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-02141712-7dde-476c-8c5c-1533ad4dd4c4 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 2ce97f89-b3ca-43bc-95bb-fc748d173ed5] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:48:56.381816 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-02141712-7dde-476c-8c5c-1533ad4dd4c4 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:56.382267 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-02141712-7dde-476c-8c5c-1533ad4dd4c4 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:56.383059 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-02141712-7dde-476c-8c5c-1533ad4dd4c4 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:56.383494 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-02141712-7dde-476c-8c5c-1533ad4dd4c4 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:56.441336 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.objects.instance [None req-02141712-7dde-476c-8c5c-1533ad4dd4c4 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lazy-loading 'flavor' on Instance uuid 2ce97f89-b3ca-43bc-95bb-fc748d173ed5 {{(pid=102212) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 12 14:48:56.657875 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-388cff29-92a9-4491-8f4c-53de4f77e2f9 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] 10.222.0.49 "POST /compute/v2.1/servers/dac49498-274f-4b45-ac30-0523cf21ee74/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.025680 May 12 14:48:56.660351 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 43/88] 10.222.0.49 () {60 vars in 1322 bytes} [Thu May 12 14:48:55 2022] POST /compute/v2.1/servers/dac49498-274f-4b45-ac30-0523cf21ee74/os-volume_attachments => generated 194 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:48:56.672459 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-f69ac4bd-d1a5-40b3-9b99-ae91c8cfe45b tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:56.674442 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-f69ac4bd-d1a5-40b3-9b99-ae91c8cfe45b tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 3062e66d-4c2a-4212-b186-ecafec6bde2e] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:48:56.688468 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-f69ac4bd-d1a5-40b3-9b99-ae91c8cfe45b tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:56.688923 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-f69ac4bd-d1a5-40b3-9b99-ae91c8cfe45b tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:56.690057 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-f69ac4bd-d1a5-40b3-9b99-ae91c8cfe45b tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:56.690169 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-f69ac4bd-d1a5-40b3-9b99-ae91c8cfe45b tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:56.874250 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-02141712-7dde-476c-8c5c-1533ad4dd4c4 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "POST /compute/v2.1/servers/2ce97f89-b3ca-43bc-95bb-fc748d173ed5/action" status: 200 len: 32 microversion: 2.1 time: 0.504097 May 12 14:48:56.875043 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 46/89] 10.222.0.49 () {60 vars in 1277 bytes} [Thu May 12 14:48:56 2022] POST /compute/v2.1/servers/2ce97f89-b3ca-43bc-95bb-fc748d173ed5/action => generated 32 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 12 14:48:56.882850 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-125aea5d-9dbd-42a8-8d15-1ef6719f9731 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:56.883981 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-125aea5d-9dbd-42a8-8d15-1ef6719f9731 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:48:56.894073 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-125aea5d-9dbd-42a8-8d15-1ef6719f9731 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:56.894655 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-125aea5d-9dbd-42a8-8d15-1ef6719f9731 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:56.895648 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-125aea5d-9dbd-42a8-8d15-1ef6719f9731 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:56.901780 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-125aea5d-9dbd-42a8-8d15-1ef6719f9731 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:56.970352 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-f69ac4bd-d1a5-40b3-9b99-ae91c8cfe45b tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e128ca83d6448c9ab1fe7dcc5467d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a090a68e336b4562aca524a95f550e04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:48:56.986412 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-f69ac4bd-d1a5-40b3-9b99-ae91c8cfe45b tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e" status: 200 len: 1364 microversion: 2.1 time: 0.323737 May 12 14:48:56.987143 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 44/90] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:48:56 2022] GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e => generated 1364 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:48:57.003090 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-4249f4b6-da38-48b5-91a8-3e2646d6909a tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:57.003938 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-4249f4b6-da38-48b5-91a8-3e2646d6909a tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 2ce97f89-b3ca-43bc-95bb-fc748d173ed5] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:48:57.013216 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-4249f4b6-da38-48b5-91a8-3e2646d6909a tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:57.013955 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-4249f4b6-da38-48b5-91a8-3e2646d6909a tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:57.014968 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-4249f4b6-da38-48b5-91a8-3e2646d6909a tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:57.015587 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-4249f4b6-da38-48b5-91a8-3e2646d6909a tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:57.265706 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-4249f4b6-da38-48b5-91a8-3e2646d6909a tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:48:57.276317 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-4249f4b6-da38-48b5-91a8-3e2646d6909a tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/2ce97f89-b3ca-43bc-95bb-fc748d173ed5" status: 200 len: 1521 microversion: 2.1 time: 0.277434 May 12 14:48:57.277786 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 45/91] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:48:56 2022] GET /compute/v2.1/servers/2ce97f89-b3ca-43bc-95bb-fc748d173ed5 => generated 1521 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:48:57.510392 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-125aea5d-9dbd-42a8-8d15-1ef6719f9731 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a641a08648b454780081ecc2e291066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a8451272cc41ebaf1598ed940bf09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:48:57.526733 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-125aea5d-9dbd-42a8-8d15-1ef6719f9731 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7" status: 200 len: 1365 microversion: 2.1 time: 0.648931 May 12 14:48:57.527342 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 47/92] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:48:56 2022] GET /compute/v2.1/servers/64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7 => generated 1365 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:48:58.003443 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-b5b15345-ddf2-4fe6-8004-09ca76d44ef1 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:58.004124 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-b5b15345-ddf2-4fe6-8004-09ca76d44ef1 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 3062e66d-4c2a-4212-b186-ecafec6bde2e] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:48:58.011394 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-b5b15345-ddf2-4fe6-8004-09ca76d44ef1 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:58.015041 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-b5b15345-ddf2-4fe6-8004-09ca76d44ef1 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:58.015041 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-b5b15345-ddf2-4fe6-8004-09ca76d44ef1 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:58.015041 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-b5b15345-ddf2-4fe6-8004-09ca76d44ef1 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:58.265779 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-b5b15345-ddf2-4fe6-8004-09ca76d44ef1 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e128ca83d6448c9ab1fe7dcc5467d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a090a68e336b4562aca524a95f550e04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:48:58.278995 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-b5b15345-ddf2-4fe6-8004-09ca76d44ef1 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e" status: 200 len: 1364 microversion: 2.1 time: 0.278973 May 12 14:48:58.280490 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 46/93] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:48:57 2022] GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e => generated 1364 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:48:58.299391 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-2836067d-0c14-4614-882a-a11424cbf938 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:58.300642 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-2836067d-0c14-4614-882a-a11424cbf938 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 2ce97f89-b3ca-43bc-95bb-fc748d173ed5] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:48:58.313230 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-2836067d-0c14-4614-882a-a11424cbf938 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:58.313839 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-2836067d-0c14-4614-882a-a11424cbf938 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:58.314975 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-2836067d-0c14-4614-882a-a11424cbf938 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:58.315763 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-2836067d-0c14-4614-882a-a11424cbf938 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:58.544540 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-e009b366-a0b7-40f4-aec7-dadbaee059fd tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:58.545343 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-e009b366-a0b7-40f4-aec7-dadbaee059fd tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:48:58.568642 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e009b366-a0b7-40f4-aec7-dadbaee059fd tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:58.569014 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e009b366-a0b7-40f4-aec7-dadbaee059fd tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:58.570429 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e009b366-a0b7-40f4-aec7-dadbaee059fd tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:58.571488 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e009b366-a0b7-40f4-aec7-dadbaee059fd tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:58.897516 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-e009b366-a0b7-40f4-aec7-dadbaee059fd tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a641a08648b454780081ecc2e291066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a8451272cc41ebaf1598ed940bf09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:48:58.914011 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-e009b366-a0b7-40f4-aec7-dadbaee059fd tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7" status: 200 len: 1365 microversion: 2.1 time: 0.371053 May 12 14:48:58.914011 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 47/94] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:48:58 2022] GET /compute/v2.1/servers/64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7 => generated 1365 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:48:58.917654 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [req-1841eb83-76a6-4310-b6a6-52bcd1057822 req-e3791847-78b8-4c1c-aded-6ffb486e7c18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3062e66d-4c2a-4212-b186-ecafec6bde2e", "name": "network-vif-plugged", "status": "completed", "tag": "dc63b69d-a47c-45f7-a4ec-c94b33fcef39"}]} {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:48:58.919620 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:48:58.919620 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: warnings.warn(msg) May 12 14:48:58.929224 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [req-1841eb83-76a6-4310-b6a6-52bcd1057822 req-e3791847-78b8-4c1c-aded-6ffb486e7c18 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:58.929663 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [req-1841eb83-76a6-4310-b6a6-52bcd1057822 req-e3791847-78b8-4c1c-aded-6ffb486e7c18 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:58.947803 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.compute.server_external_events [req-1841eb83-76a6-4310-b6a6-52bcd1057822 req-e3791847-78b8-4c1c-aded-6ffb486e7c18 service nova] Creating event network-vif-plugged:dc63b69d-a47c-45f7-a4ec-c94b33fcef39 for instance 3062e66d-4c2a-4212-b186-ecafec6bde2e on hv-cinder-83118 May 12 14:48:58.954114 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [req-1841eb83-76a6-4310-b6a6-52bcd1057822 req-e3791847-78b8-4c1c-aded-6ffb486e7c18 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040437 May 12 14:48:58.954729 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 48/95] 10.222.0.49 () {64 vars in 1317 bytes} [Thu May 12 14:48:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:48:59.237666 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-2836067d-0c14-4614-882a-a11424cbf938 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:48:59.256070 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-2836067d-0c14-4614-882a-a11424cbf938 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/2ce97f89-b3ca-43bc-95bb-fc748d173ed5" status: 200 len: 1521 microversion: 2.1 time: 0.965334 May 12 14:48:59.258254 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 48/96] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:48:58 2022] GET /compute/v2.1/servers/2ce97f89-b3ca-43bc-95bb-fc748d173ed5 => generated 1521 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:48:59.304943 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-13ed9352-d0d7-4783-b73b-1f50e6e24cc3 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:59.305787 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-13ed9352-d0d7-4783-b73b-1f50e6e24cc3 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 3062e66d-4c2a-4212-b186-ecafec6bde2e] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:48:59.320557 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-13ed9352-d0d7-4783-b73b-1f50e6e24cc3 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:59.321158 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-13ed9352-d0d7-4783-b73b-1f50e6e24cc3 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:59.322990 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-13ed9352-d0d7-4783-b73b-1f50e6e24cc3 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:59.323975 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-13ed9352-d0d7-4783-b73b-1f50e6e24cc3 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:59.574617 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-13ed9352-d0d7-4783-b73b-1f50e6e24cc3 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e128ca83d6448c9ab1fe7dcc5467d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a090a68e336b4562aca524a95f550e04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:48:59.582927 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-13ed9352-d0d7-4783-b73b-1f50e6e24cc3 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e" status: 200 len: 1364 microversion: 2.1 time: 0.282496 May 12 14:48:59.583580 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 49/97] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:48:59 2022] GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e => generated 1364 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:48:59.928277 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-9de360f9-204c-4721-8fba-e7cdb309085f tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:48:59.929823 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-9de360f9-204c-4721-8fba-e7cdb309085f tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:48:59.939380 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-9de360f9-204c-4721-8fba-e7cdb309085f tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:59.940072 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-9de360f9-204c-4721-8fba-e7cdb309085f tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:48:59.940845 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-9de360f9-204c-4721-8fba-e7cdb309085f tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:48:59.941434 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-9de360f9-204c-4721-8fba-e7cdb309085f tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:00.164283 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-9de360f9-204c-4721-8fba-e7cdb309085f tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a641a08648b454780081ecc2e291066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a8451272cc41ebaf1598ed940bf09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:00.174297 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-9de360f9-204c-4721-8fba-e7cdb309085f tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7" status: 200 len: 1365 microversion: 2.1 time: 0.250263 May 12 14:49:00.183826 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 49/98] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:48:59 2022] GET /compute/v2.1/servers/64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7 => generated 1365 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:49:00.273763 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-7548bafb-118d-453b-ad08-778cb6dcc689 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:00.274582 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-7548bafb-118d-453b-ad08-778cb6dcc689 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 2ce97f89-b3ca-43bc-95bb-fc748d173ed5] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:49:00.282687 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-7548bafb-118d-453b-ad08-778cb6dcc689 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:00.283277 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-7548bafb-118d-453b-ad08-778cb6dcc689 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:00.284293 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-7548bafb-118d-453b-ad08-778cb6dcc689 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:00.284820 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-7548bafb-118d-453b-ad08-778cb6dcc689 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:00.548548 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-7548bafb-118d-453b-ad08-778cb6dcc689 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:00.558291 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-7548bafb-118d-453b-ad08-778cb6dcc689 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/2ce97f89-b3ca-43bc-95bb-fc748d173ed5" status: 200 len: 1521 microversion: 2.1 time: 0.288172 May 12 14:49:00.558891 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 50/99] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:49:00 2022] GET /compute/v2.1/servers/2ce97f89-b3ca-43bc-95bb-fc748d173ed5 => generated 1521 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:49:00.599791 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-fd786a06-0c0d-4b58-bea3-70786976236a tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:00.600391 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-fd786a06-0c0d-4b58-bea3-70786976236a tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 3062e66d-4c2a-4212-b186-ecafec6bde2e] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:49:00.607641 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-fd786a06-0c0d-4b58-bea3-70786976236a tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:00.608081 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-fd786a06-0c0d-4b58-bea3-70786976236a tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:00.608834 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-fd786a06-0c0d-4b58-bea3-70786976236a tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:00.609261 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-fd786a06-0c0d-4b58-bea3-70786976236a tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:00.819623 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-fd786a06-0c0d-4b58-bea3-70786976236a tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e128ca83d6448c9ab1fe7dcc5467d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a090a68e336b4562aca524a95f550e04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:00.831028 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-fd786a06-0c0d-4b58-bea3-70786976236a tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e" status: 200 len: 1364 microversion: 2.1 time: 0.233325 May 12 14:49:00.831028 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 50/100] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:49:00 2022] GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e => generated 1364 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:49:01.191048 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-4cfb90cf-4cf7-48bb-b6b4-b108f50611a8 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:01.191766 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-4cfb90cf-4cf7-48bb-b6b4-b108f50611a8 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:49:01.209894 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-4cfb90cf-4cf7-48bb-b6b4-b108f50611a8 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:01.210704 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-4cfb90cf-4cf7-48bb-b6b4-b108f50611a8 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:01.211596 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-4cfb90cf-4cf7-48bb-b6b4-b108f50611a8 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:01.212106 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-4cfb90cf-4cf7-48bb-b6b4-b108f50611a8 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:01.437129 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-4cfb90cf-4cf7-48bb-b6b4-b108f50611a8 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a641a08648b454780081ecc2e291066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a8451272cc41ebaf1598ed940bf09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:01.445184 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-4cfb90cf-4cf7-48bb-b6b4-b108f50611a8 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7" status: 200 len: 1365 microversion: 2.1 time: 0.257935 May 12 14:49:01.445759 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 51/101] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:49:01 2022] GET /compute/v2.1/servers/64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7 => generated 1365 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:49:01.575388 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-c66100fe-72c3-4dd9-8da8-2d87cfb9a059 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:01.576022 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-c66100fe-72c3-4dd9-8da8-2d87cfb9a059 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 2ce97f89-b3ca-43bc-95bb-fc748d173ed5] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:49:01.585992 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-c66100fe-72c3-4dd9-8da8-2d87cfb9a059 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:01.586843 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-c66100fe-72c3-4dd9-8da8-2d87cfb9a059 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:01.588699 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-c66100fe-72c3-4dd9-8da8-2d87cfb9a059 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:01.589387 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-c66100fe-72c3-4dd9-8da8-2d87cfb9a059 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:01.798253 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-c66100fe-72c3-4dd9-8da8-2d87cfb9a059 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:01.807790 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-c66100fe-72c3-4dd9-8da8-2d87cfb9a059 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/2ce97f89-b3ca-43bc-95bb-fc748d173ed5" status: 200 len: 1521 microversion: 2.1 time: 0.236185 May 12 14:49:01.817344 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 51/102] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:49:01 2022] GET /compute/v2.1/servers/2ce97f89-b3ca-43bc-95bb-fc748d173ed5 => generated 1521 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:49:01.845095 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-65cbdf41-395e-4034-abeb-33ed5b1d9225 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:01.845712 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-65cbdf41-395e-4034-abeb-33ed5b1d9225 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 3062e66d-4c2a-4212-b186-ecafec6bde2e] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:49:01.853860 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-65cbdf41-395e-4034-abeb-33ed5b1d9225 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:01.854493 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-65cbdf41-395e-4034-abeb-33ed5b1d9225 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:01.855742 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-65cbdf41-395e-4034-abeb-33ed5b1d9225 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:01.856269 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-65cbdf41-395e-4034-abeb-33ed5b1d9225 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:02.060300 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-65cbdf41-395e-4034-abeb-33ed5b1d9225 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e128ca83d6448c9ab1fe7dcc5467d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a090a68e336b4562aca524a95f550e04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:02.070751 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-65cbdf41-395e-4034-abeb-33ed5b1d9225 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e" status: 200 len: 1550 microversion: 2.1 time: 0.229224 May 12 14:49:02.071364 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 52/103] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:49:01 2022] GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e => generated 1550 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:49:02.092449 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-bd1be958-4cd8-4197-a2a1-670de4727180 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:02.093037 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-bd1be958-4cd8-4197-a2a1-670de4727180 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 3062e66d-4c2a-4212-b186-ecafec6bde2e] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:49:02.100693 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-bd1be958-4cd8-4197-a2a1-670de4727180 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:02.101160 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-bd1be958-4cd8-4197-a2a1-670de4727180 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:02.101933 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-bd1be958-4cd8-4197-a2a1-670de4727180 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:02.102365 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-bd1be958-4cd8-4197-a2a1-670de4727180 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:02.285872 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-bd1be958-4cd8-4197-a2a1-670de4727180 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.197978 May 12 14:49:02.286504 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 52/104] 10.222.0.49 () {58 vars in 1274 bytes} [Thu May 12 14:49:02 2022] GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e/os-interface => generated 285 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 14:49:02.463822 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-60e0413a-2f10-45bf-8094-bdac808a73ac tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:02.464991 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-60e0413a-2f10-45bf-8094-bdac808a73ac tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:49:02.476224 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-60e0413a-2f10-45bf-8094-bdac808a73ac tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:02.477288 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-60e0413a-2f10-45bf-8094-bdac808a73ac tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:02.479083 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-60e0413a-2f10-45bf-8094-bdac808a73ac tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:02.479555 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-60e0413a-2f10-45bf-8094-bdac808a73ac tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:02.708409 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-60e0413a-2f10-45bf-8094-bdac808a73ac tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a641a08648b454780081ecc2e291066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a8451272cc41ebaf1598ed940bf09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:02.717834 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-60e0413a-2f10-45bf-8094-bdac808a73ac tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7" status: 200 len: 1365 microversion: 2.1 time: 0.260192 May 12 14:49:02.718416 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 53/105] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:49:02 2022] GET /compute/v2.1/servers/64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7 => generated 1365 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:49:02.825351 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-92e6d33b-87b7-49a5-bcb3-5602c13b4476 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:02.825947 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-92e6d33b-87b7-49a5-bcb3-5602c13b4476 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 2ce97f89-b3ca-43bc-95bb-fc748d173ed5] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:49:02.833321 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-92e6d33b-87b7-49a5-bcb3-5602c13b4476 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:02.833781 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-92e6d33b-87b7-49a5-bcb3-5602c13b4476 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:02.834669 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-92e6d33b-87b7-49a5-bcb3-5602c13b4476 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:02.835157 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-92e6d33b-87b7-49a5-bcb3-5602c13b4476 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:03.458086 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-92e6d33b-87b7-49a5-bcb3-5602c13b4476 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:03.466617 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-92e6d33b-87b7-49a5-bcb3-5602c13b4476 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/2ce97f89-b3ca-43bc-95bb-fc748d173ed5" status: 200 len: 1521 microversion: 2.1 time: 0.645517 May 12 14:49:03.467238 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 53/106] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:49:02 2022] GET /compute/v2.1/servers/2ce97f89-b3ca-43bc-95bb-fc748d173ed5 => generated 1521 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:49:03.735046 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-619428ec-d652-4ad3-b33d-4a8f3a0ce427 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:03.735665 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-619428ec-d652-4ad3-b33d-4a8f3a0ce427 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:49:03.747579 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-619428ec-d652-4ad3-b33d-4a8f3a0ce427 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:03.748224 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-619428ec-d652-4ad3-b33d-4a8f3a0ce427 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:03.749201 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-619428ec-d652-4ad3-b33d-4a8f3a0ce427 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:03.750099 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-619428ec-d652-4ad3-b33d-4a8f3a0ce427 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:03.976749 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-619428ec-d652-4ad3-b33d-4a8f3a0ce427 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a641a08648b454780081ecc2e291066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a8451272cc41ebaf1598ed940bf09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:03.985618 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-619428ec-d652-4ad3-b33d-4a8f3a0ce427 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7" status: 200 len: 1365 microversion: 2.1 time: 0.254425 May 12 14:49:03.986255 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 54/107] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:49:03 2022] GET /compute/v2.1/servers/64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7 => generated 1365 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:49:04.484351 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-f347840f-1914-4892-9f4a-d9b22cbde7c4 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:04.485201 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-f347840f-1914-4892-9f4a-d9b22cbde7c4 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 2ce97f89-b3ca-43bc-95bb-fc748d173ed5] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:49:04.493192 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-f347840f-1914-4892-9f4a-d9b22cbde7c4 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:04.494944 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-f347840f-1914-4892-9f4a-d9b22cbde7c4 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:04.496130 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-f347840f-1914-4892-9f4a-d9b22cbde7c4 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:04.496727 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-f347840f-1914-4892-9f4a-d9b22cbde7c4 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:04.530332 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [req-ef714947-08ff-4723-8163-2d0a9eb5948b req-05e54a81-e980-452a-a554-ffd3bec04e3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7", "name": "network-vif-plugged", "status": "completed", "tag": "b9ae57f3-8cbe-4bb3-80d3-db854a810952"}]} {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:49:04.532079 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:49:04.532079 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: warnings.warn(msg) May 12 14:49:04.557138 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [req-ef714947-08ff-4723-8163-2d0a9eb5948b req-05e54a81-e980-452a-a554-ffd3bec04e3f service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:04.557138 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [req-ef714947-08ff-4723-8163-2d0a9eb5948b req-05e54a81-e980-452a-a554-ffd3bec04e3f service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:04.574841 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.compute.server_external_events [req-ef714947-08ff-4723-8163-2d0a9eb5948b req-05e54a81-e980-452a-a554-ffd3bec04e3f service nova] Creating event network-vif-plugged:b9ae57f3-8cbe-4bb3-80d3-db854a810952 for instance 64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7 on hv-cinder-83118 May 12 14:49:04.605832 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [req-ef714947-08ff-4723-8163-2d0a9eb5948b req-05e54a81-e980-452a-a554-ffd3bec04e3f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079004 May 12 14:49:04.609222 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 55/108] 10.222.0.49 () {64 vars in 1317 bytes} [Thu May 12 14:49:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 14:49:04.780888 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [req-699082d8-13c1-475c-8011-a780012488e2 req-a3168518-77c6-4878-aa32-5d5c5158be09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3062e66d-4c2a-4212-b186-ecafec6bde2e", "tag": "dc63b69d-a47c-45f7-a4ec-c94b33fcef39"}]} {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:49:04.784164 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:49:04.784164 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: warnings.warn(msg) May 12 14:49:04.806037 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [req-699082d8-13c1-475c-8011-a780012488e2 req-a3168518-77c6-4878-aa32-5d5c5158be09 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:04.810285 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [req-699082d8-13c1-475c-8011-a780012488e2 req-a3168518-77c6-4878-aa32-5d5c5158be09 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:04.834754 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.compute.server_external_events [req-699082d8-13c1-475c-8011-a780012488e2 req-a3168518-77c6-4878-aa32-5d5c5158be09 service nova] Creating event network-changed:dc63b69d-a47c-45f7-a4ec-c94b33fcef39 for instance 3062e66d-4c2a-4212-b186-ecafec6bde2e on hv-cinder-83118 May 12 14:49:04.839791 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [req-699082d8-13c1-475c-8011-a780012488e2 req-a3168518-77c6-4878-aa32-5d5c5158be09 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063961 May 12 14:49:04.840871 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 56/109] 10.222.0.49 () {64 vars in 1317 bytes} [Thu May 12 14:49:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 14:49:04.934067 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-f347840f-1914-4892-9f4a-d9b22cbde7c4 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:04.948237 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-f347840f-1914-4892-9f4a-d9b22cbde7c4 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/2ce97f89-b3ca-43bc-95bb-fc748d173ed5" status: 200 len: 1521 microversion: 2.1 time: 0.465435 May 12 14:49:04.949634 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 54/110] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:49:04 2022] GET /compute/v2.1/servers/2ce97f89-b3ca-43bc-95bb-fc748d173ed5 => generated 1521 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:49:05.004028 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-6882ab6c-4bb5-4d2a-bbbf-973783bb917f tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:05.005485 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-6882ab6c-4bb5-4d2a-bbbf-973783bb917f tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:49:05.014794 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-6882ab6c-4bb5-4d2a-bbbf-973783bb917f tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:05.016128 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-6882ab6c-4bb5-4d2a-bbbf-973783bb917f tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:05.016972 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-6882ab6c-4bb5-4d2a-bbbf-973783bb917f tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:05.017526 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-6882ab6c-4bb5-4d2a-bbbf-973783bb917f tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:05.342135 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-6882ab6c-4bb5-4d2a-bbbf-973783bb917f tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a641a08648b454780081ecc2e291066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a8451272cc41ebaf1598ed940bf09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:05.350803 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-6882ab6c-4bb5-4d2a-bbbf-973783bb917f tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7" status: 200 len: 1365 microversion: 2.1 time: 0.351561 May 12 14:49:05.360620 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 57/111] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:49:04 2022] GET /compute/v2.1/servers/64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7 => generated 1365 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:49:05.967977 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-58842b8d-717c-413c-ae2e-1ff45e24d319 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:05.968762 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-58842b8d-717c-413c-ae2e-1ff45e24d319 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 2ce97f89-b3ca-43bc-95bb-fc748d173ed5] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:49:05.977173 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-58842b8d-717c-413c-ae2e-1ff45e24d319 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:05.977847 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-58842b8d-717c-413c-ae2e-1ff45e24d319 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:05.978959 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-58842b8d-717c-413c-ae2e-1ff45e24d319 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:05.979615 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-58842b8d-717c-413c-ae2e-1ff45e24d319 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:06.263148 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-58842b8d-717c-413c-ae2e-1ff45e24d319 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:06.271823 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-58842b8d-717c-413c-ae2e-1ff45e24d319 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/2ce97f89-b3ca-43bc-95bb-fc748d173ed5" status: 200 len: 1521 microversion: 2.1 time: 0.310071 May 12 14:49:06.272754 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 55/112] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:49:05 2022] GET /compute/v2.1/servers/2ce97f89-b3ca-43bc-95bb-fc748d173ed5 => generated 1521 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:49:06.368146 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-bba1d60e-dc44-488a-8363-a59e08f22766 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:06.368772 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-bba1d60e-dc44-488a-8363-a59e08f22766 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:49:06.375999 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-bba1d60e-dc44-488a-8363-a59e08f22766 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:06.376543 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-bba1d60e-dc44-488a-8363-a59e08f22766 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:06.377377 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-bba1d60e-dc44-488a-8363-a59e08f22766 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:06.377889 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-bba1d60e-dc44-488a-8363-a59e08f22766 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:06.622333 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-bba1d60e-dc44-488a-8363-a59e08f22766 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a641a08648b454780081ecc2e291066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a8451272cc41ebaf1598ed940bf09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:06.630687 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-bba1d60e-dc44-488a-8363-a59e08f22766 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7" status: 200 len: 1365 microversion: 2.1 time: 0.266429 May 12 14:49:06.631323 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 58/113] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:49:06 2022] GET /compute/v2.1/servers/64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7 => generated 1365 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:49:07.292996 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-56dd849c-9092-441a-bafb-2a0793a8c3a4 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:07.292996 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-56dd849c-9092-441a-bafb-2a0793a8c3a4 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 2ce97f89-b3ca-43bc-95bb-fc748d173ed5] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:49:07.310066 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-56dd849c-9092-441a-bafb-2a0793a8c3a4 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:07.310950 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-56dd849c-9092-441a-bafb-2a0793a8c3a4 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:07.312768 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-56dd849c-9092-441a-bafb-2a0793a8c3a4 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:07.313397 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-56dd849c-9092-441a-bafb-2a0793a8c3a4 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:07.648942 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-166a8ba7-4681-492d-bc36-7e97590da541 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:07.650877 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-166a8ba7-4681-492d-bc36-7e97590da541 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:49:07.664967 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-166a8ba7-4681-492d-bc36-7e97590da541 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:07.665649 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-166a8ba7-4681-492d-bc36-7e97590da541 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:07.667873 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-166a8ba7-4681-492d-bc36-7e97590da541 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:07.668526 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-166a8ba7-4681-492d-bc36-7e97590da541 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:07.808974 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-56dd849c-9092-441a-bafb-2a0793a8c3a4 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:07.819541 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-56dd849c-9092-441a-bafb-2a0793a8c3a4 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/2ce97f89-b3ca-43bc-95bb-fc748d173ed5" status: 200 len: 1521 microversion: 2.1 time: 0.533518 May 12 14:49:07.820174 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 56/114] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:49:07 2022] GET /compute/v2.1/servers/2ce97f89-b3ca-43bc-95bb-fc748d173ed5 => generated 1521 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:49:07.903086 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-166a8ba7-4681-492d-bc36-7e97590da541 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a641a08648b454780081ecc2e291066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a8451272cc41ebaf1598ed940bf09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:07.911459 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-166a8ba7-4681-492d-bc36-7e97590da541 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7" status: 200 len: 1365 microversion: 2.1 time: 0.266791 May 12 14:49:07.913270 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 59/115] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:49:07 2022] GET /compute/v2.1/servers/64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7 => generated 1365 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:49:08.836477 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-86133bf9-a2ae-46bf-8c89-5729d328c776 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:08.837071 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-86133bf9-a2ae-46bf-8c89-5729d328c776 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 2ce97f89-b3ca-43bc-95bb-fc748d173ed5] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:49:08.844971 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-86133bf9-a2ae-46bf-8c89-5729d328c776 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:08.845420 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-86133bf9-a2ae-46bf-8c89-5729d328c776 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:08.846183 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-86133bf9-a2ae-46bf-8c89-5729d328c776 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:08.846609 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-86133bf9-a2ae-46bf-8c89-5729d328c776 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:08.938154 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-f0376555-8694-4131-bb12-4b9f2419d565 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:08.938764 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-f0376555-8694-4131-bb12-4b9f2419d565 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:49:08.946741 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-f0376555-8694-4131-bb12-4b9f2419d565 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:08.947491 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-f0376555-8694-4131-bb12-4b9f2419d565 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:08.950205 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-f0376555-8694-4131-bb12-4b9f2419d565 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:08.950205 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-f0376555-8694-4131-bb12-4b9f2419d565 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:09.087034 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-86133bf9-a2ae-46bf-8c89-5729d328c776 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:09.096139 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-86133bf9-a2ae-46bf-8c89-5729d328c776 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/2ce97f89-b3ca-43bc-95bb-fc748d173ed5" status: 200 len: 1521 microversion: 2.1 time: 0.263275 May 12 14:49:09.097027 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 57/116] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:49:08 2022] GET /compute/v2.1/servers/2ce97f89-b3ca-43bc-95bb-fc748d173ed5 => generated 1521 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:49:09.183858 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-f0376555-8694-4131-bb12-4b9f2419d565 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a641a08648b454780081ecc2e291066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a8451272cc41ebaf1598ed940bf09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:09.192446 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-f0376555-8694-4131-bb12-4b9f2419d565 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7" status: 200 len: 1365 microversion: 2.1 time: 0.258187 May 12 14:49:09.193330 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 60/117] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:49:08 2022] GET /compute/v2.1/servers/64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7 => generated 1365 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:49:10.095681 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-5fd42c2b-11db-4d89-b6ce-b89cfd0b27f4 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:10.096885 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-5fd42c2b-11db-4d89-b6ce-b89cfd0b27f4 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] [instance: dac49498-274f-4b45-ac30-0523cf21ee74] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:49:10.105191 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-5fd42c2b-11db-4d89-b6ce-b89cfd0b27f4 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:10.108627 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-5fd42c2b-11db-4d89-b6ce-b89cfd0b27f4 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:10.108627 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-5fd42c2b-11db-4d89-b6ce-b89cfd0b27f4 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:10.108627 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-5fd42c2b-11db-4d89-b6ce-b89cfd0b27f4 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:10.113983 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-af6da333-3247-4ead-bb10-7c15b2597094 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:10.114864 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-af6da333-3247-4ead-bb10-7c15b2597094 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 2ce97f89-b3ca-43bc-95bb-fc748d173ed5] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:49:10.123590 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-af6da333-3247-4ead-bb10-7c15b2597094 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:10.124123 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-af6da333-3247-4ead-bb10-7c15b2597094 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:10.125324 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-af6da333-3247-4ead-bb10-7c15b2597094 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:10.125616 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-af6da333-3247-4ead-bb10-7c15b2597094 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:10.177823 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-5fd42c2b-11db-4d89-b6ce-b89cfd0b27f4 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] [instance: dac49498-274f-4b45-ac30-0523cf21ee74] Going to try to terminate instance {{(pid=102212) delete /opt/stack/nova/nova/compute/api.py:2562}} May 12 14:49:10.402695 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-af6da333-3247-4ead-bb10-7c15b2597094 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:10.411266 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-af6da333-3247-4ead-bb10-7c15b2597094 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/2ce97f89-b3ca-43bc-95bb-fc748d173ed5" status: 200 len: 1521 microversion: 2.1 time: 0.301218 May 12 14:49:10.411998 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 61/118] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:49:10 2022] GET /compute/v2.1/servers/2ce97f89-b3ca-43bc-95bb-fc748d173ed5 => generated 1521 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:49:10.416227 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-249f5259-dcd1-40c0-8378-69725d32d698 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:10.416830 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-249f5259-dcd1-40c0-8378-69725d32d698 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:49:10.423846 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-249f5259-dcd1-40c0-8378-69725d32d698 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:10.424294 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-249f5259-dcd1-40c0-8378-69725d32d698 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:10.425054 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-249f5259-dcd1-40c0-8378-69725d32d698 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:10.425486 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-249f5259-dcd1-40c0-8378-69725d32d698 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:10.547573 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-5fd42c2b-11db-4d89-b6ce-b89cfd0b27f4 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] 10.222.0.49 "DELETE /compute/v2.1/servers/dac49498-274f-4b45-ac30-0523cf21ee74" status: 204 len: 0 microversion: 2.1 time: 0.455807 May 12 14:49:10.548172 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 58/119] 10.222.0.49 () {58 vars in 1238 bytes} [Thu May 12 14:49:10 2022] DELETE /compute/v2.1/servers/dac49498-274f-4b45-ac30-0523cf21ee74 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 14:49:10.557604 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-bf4a3ab2-17cc-4594-8d2d-fc04e5ca3ab5 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:10.558479 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-bf4a3ab2-17cc-4594-8d2d-fc04e5ca3ab5 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] [instance: dac49498-274f-4b45-ac30-0523cf21ee74] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:49:10.566642 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-bf4a3ab2-17cc-4594-8d2d-fc04e5ca3ab5 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:10.567127 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-bf4a3ab2-17cc-4594-8d2d-fc04e5ca3ab5 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:10.567901 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-bf4a3ab2-17cc-4594-8d2d-fc04e5ca3ab5 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:10.568339 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-bf4a3ab2-17cc-4594-8d2d-fc04e5ca3ab5 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:10.623212 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-249f5259-dcd1-40c0-8378-69725d32d698 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a641a08648b454780081ecc2e291066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a8451272cc41ebaf1598ed940bf09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:10.638321 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-249f5259-dcd1-40c0-8378-69725d32d698 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7" status: 200 len: 1555 microversion: 2.1 time: 0.223461 May 12 14:49:10.647834 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 62/120] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:49:10 2022] GET /compute/v2.1/servers/64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7 => generated 1555 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:49:10.653797 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-d911ca82-721c-4332-9b13-be76eeb054a1 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:10.654523 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-d911ca82-721c-4332-9b13-be76eeb054a1 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:49:10.662522 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-d911ca82-721c-4332-9b13-be76eeb054a1 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:10.663013 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-d911ca82-721c-4332-9b13-be76eeb054a1 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:10.663796 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-d911ca82-721c-4332-9b13-be76eeb054a1 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:10.664231 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-d911ca82-721c-4332-9b13-be76eeb054a1 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:10.795688 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-bf4a3ab2-17cc-4594-8d2d-fc04e5ca3ab5 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1458fa830b624a1cb64917dc815206ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0fc219e42a416ea2f81435544b43bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:10.805927 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-bf4a3ab2-17cc-4594-8d2d-fc04e5ca3ab5 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] 10.222.0.49 "GET /compute/v2.1/servers/dac49498-274f-4b45-ac30-0523cf21ee74" status: 200 len: 1554 microversion: 2.1 time: 0.253083 May 12 14:49:10.806888 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 59/121] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:49:10 2022] GET /compute/v2.1/servers/dac49498-274f-4b45-ac30-0523cf21ee74 => generated 1554 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:49:10.867358 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-d911ca82-721c-4332-9b13-be76eeb054a1 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.217670 May 12 14:49:10.868029 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 63/122] 10.222.0.49 () {58 vars in 1274 bytes} [Thu May 12 14:49:10 2022] GET /compute/v2.1/servers/64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7/os-interface => generated 284 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:49:11.428465 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-4b51a67a-f91d-42b2-94f0-f5660f83ac08 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:11.429795 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-4b51a67a-f91d-42b2-94f0-f5660f83ac08 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 2ce97f89-b3ca-43bc-95bb-fc748d173ed5] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:49:11.436380 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-4b51a67a-f91d-42b2-94f0-f5660f83ac08 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:11.436832 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-4b51a67a-f91d-42b2-94f0-f5660f83ac08 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:11.437596 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-4b51a67a-f91d-42b2-94f0-f5660f83ac08 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:11.438030 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-4b51a67a-f91d-42b2-94f0-f5660f83ac08 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:11.648257 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-4b51a67a-f91d-42b2-94f0-f5660f83ac08 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:11.658666 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-4b51a67a-f91d-42b2-94f0-f5660f83ac08 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/2ce97f89-b3ca-43bc-95bb-fc748d173ed5" status: 200 len: 1521 microversion: 2.1 time: 0.233836 May 12 14:49:11.659422 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 60/123] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:49:11 2022] GET /compute/v2.1/servers/2ce97f89-b3ca-43bc-95bb-fc748d173ed5 => generated 1521 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:49:11.823704 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-49951e08-9264-4201-9fbb-9b32afa20d8c tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:11.825163 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-49951e08-9264-4201-9fbb-9b32afa20d8c tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] [instance: dac49498-274f-4b45-ac30-0523cf21ee74] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:49:11.831937 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-49951e08-9264-4201-9fbb-9b32afa20d8c tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:11.832375 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-49951e08-9264-4201-9fbb-9b32afa20d8c tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:11.833136 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-49951e08-9264-4201-9fbb-9b32afa20d8c tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:11.833561 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-49951e08-9264-4201-9fbb-9b32afa20d8c tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:12.412658 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-49951e08-9264-4201-9fbb-9b32afa20d8c tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1458fa830b624a1cb64917dc815206ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0fc219e42a416ea2f81435544b43bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:12.418380 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-49951e08-9264-4201-9fbb-9b32afa20d8c tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] 10.222.0.49 "GET /compute/v2.1/servers/dac49498-274f-4b45-ac30-0523cf21ee74" status: 200 len: 1554 microversion: 2.1 time: 0.598790 May 12 14:49:12.419006 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 64/124] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:49:11 2022] GET /compute/v2.1/servers/dac49498-274f-4b45-ac30-0523cf21ee74 => generated 1554 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:49:12.679988 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-a52af03a-a125-4d33-926b-cf57b6b59109 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:12.681188 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-a52af03a-a125-4d33-926b-cf57b6b59109 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 2ce97f89-b3ca-43bc-95bb-fc748d173ed5] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:49:12.689186 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-a52af03a-a125-4d33-926b-cf57b6b59109 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:12.689632 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-a52af03a-a125-4d33-926b-cf57b6b59109 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:12.690403 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-a52af03a-a125-4d33-926b-cf57b6b59109 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:12.690859 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-a52af03a-a125-4d33-926b-cf57b6b59109 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:12.887007 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [req-c18514e5-c017-4944-bfdd-1de405da9ee2 req-38bcf1ee-e30f-4d6e-9816-a5632c93b9c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7", "tag": "b9ae57f3-8cbe-4bb3-80d3-db854a810952"}]} {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:49:12.888843 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:49:12.888843 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: warnings.warn(msg) May 12 14:49:12.899009 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [req-c18514e5-c017-4944-bfdd-1de405da9ee2 req-38bcf1ee-e30f-4d6e-9816-a5632c93b9c1 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:12.899648 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [req-c18514e5-c017-4944-bfdd-1de405da9ee2 req-38bcf1ee-e30f-4d6e-9816-a5632c93b9c1 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:12.928958 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.compute.server_external_events [req-c18514e5-c017-4944-bfdd-1de405da9ee2 req-38bcf1ee-e30f-4d6e-9816-a5632c93b9c1 service nova] Creating event network-changed:b9ae57f3-8cbe-4bb3-80d3-db854a810952 for instance 64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7 on hv-cinder-83118 May 12 14:49:12.938464 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [req-c18514e5-c017-4944-bfdd-1de405da9ee2 req-38bcf1ee-e30f-4d6e-9816-a5632c93b9c1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055569 May 12 14:49:12.940565 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 65/125] 10.222.0.49 () {64 vars in 1317 bytes} [Thu May 12 14:49:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 14:49:13.088946 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-a52af03a-a125-4d33-926b-cf57b6b59109 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:13.099750 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-a52af03a-a125-4d33-926b-cf57b6b59109 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/2ce97f89-b3ca-43bc-95bb-fc748d173ed5" status: 200 len: 1521 microversion: 2.1 time: 0.423254 May 12 14:49:13.101666 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 61/126] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:49:12 2022] GET /compute/v2.1/servers/2ce97f89-b3ca-43bc-95bb-fc748d173ed5 => generated 1521 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:49:13.439643 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-1157065f-7c9c-4a15-b15b-63b89c0bd78e tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:13.440693 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-1157065f-7c9c-4a15-b15b-63b89c0bd78e tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] [instance: dac49498-274f-4b45-ac30-0523cf21ee74] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:49:13.456440 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-1157065f-7c9c-4a15-b15b-63b89c0bd78e tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:13.456949 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-1157065f-7c9c-4a15-b15b-63b89c0bd78e tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:13.458084 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-1157065f-7c9c-4a15-b15b-63b89c0bd78e tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:13.458537 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-1157065f-7c9c-4a15-b15b-63b89c0bd78e tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:13.688943 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-1157065f-7c9c-4a15-b15b-63b89c0bd78e tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1458fa830b624a1cb64917dc815206ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0fc219e42a416ea2f81435544b43bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:13.698289 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-1157065f-7c9c-4a15-b15b-63b89c0bd78e tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] 10.222.0.49 "GET /compute/v2.1/servers/dac49498-274f-4b45-ac30-0523cf21ee74" status: 200 len: 1554 microversion: 2.1 time: 0.263161 May 12 14:49:13.699808 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 66/127] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:49:13 2022] GET /compute/v2.1/servers/dac49498-274f-4b45-ac30-0523cf21ee74 => generated 1554 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:49:14.126306 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-7788a336-9223-479d-9797-8a541ba9d9f1 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:14.126977 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-7788a336-9223-479d-9797-8a541ba9d9f1 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 2ce97f89-b3ca-43bc-95bb-fc748d173ed5] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:49:14.135351 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-7788a336-9223-479d-9797-8a541ba9d9f1 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:14.137194 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-7788a336-9223-479d-9797-8a541ba9d9f1 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:14.137194 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-7788a336-9223-479d-9797-8a541ba9d9f1 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:14.137668 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-7788a336-9223-479d-9797-8a541ba9d9f1 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:14.448850 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [req-4d5d05e1-8a88-46ce-b53a-12eba333b5fe req-01ed1bc8-4382-46b1-b4fe-e899a316eeb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dac49498-274f-4b45-ac30-0523cf21ee74", "name": "network-vif-deleted", "tag": "2044ac30-5708-42cb-b26e-840d25d8c8a6"}]} {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:49:14.450446 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:49:14.450446 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: warnings.warn(msg) May 12 14:49:14.458718 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [req-4d5d05e1-8a88-46ce-b53a-12eba333b5fe req-01ed1bc8-4382-46b1-b4fe-e899a316eeb0 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:14.484832 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [req-4d5d05e1-8a88-46ce-b53a-12eba333b5fe req-01ed1bc8-4382-46b1-b4fe-e899a316eeb0 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:14.484832 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.compute.server_external_events [req-4d5d05e1-8a88-46ce-b53a-12eba333b5fe req-01ed1bc8-4382-46b1-b4fe-e899a316eeb0 service nova] Creating event network-vif-deleted:2044ac30-5708-42cb-b26e-840d25d8c8a6 for instance dac49498-274f-4b45-ac30-0523cf21ee74 on hv-cinder-83118 May 12 14:49:14.488687 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [req-4d5d05e1-8a88-46ce-b53a-12eba333b5fe req-01ed1bc8-4382-46b1-b4fe-e899a316eeb0 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043345 May 12 14:49:14.491639 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 67/128] 10.222.0.49 () {64 vars in 1317 bytes} [Thu May 12 14:49:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 14:49:14.574964 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-7788a336-9223-479d-9797-8a541ba9d9f1 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:14.574964 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-7788a336-9223-479d-9797-8a541ba9d9f1 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/2ce97f89-b3ca-43bc-95bb-fc748d173ed5" status: 200 len: 1521 microversion: 2.1 time: 0.460631 May 12 14:49:14.575529 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 62/129] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:49:14 2022] GET /compute/v2.1/servers/2ce97f89-b3ca-43bc-95bb-fc748d173ed5 => generated 1521 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:49:14.724188 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-6c598655-bdcc-4901-a617-193dbc287316 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:14.725848 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-6c598655-bdcc-4901-a617-193dbc287316 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] [instance: dac49498-274f-4b45-ac30-0523cf21ee74] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:49:14.736142 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-6c598655-bdcc-4901-a617-193dbc287316 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:14.736896 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-6c598655-bdcc-4901-a617-193dbc287316 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:14.737688 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-6c598655-bdcc-4901-a617-193dbc287316 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:14.738145 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-6c598655-bdcc-4901-a617-193dbc287316 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:14.882938 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-6c598655-bdcc-4901-a617-193dbc287316 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1458fa830b624a1cb64917dc815206ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0fc219e42a416ea2f81435544b43bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:14.893154 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-6c598655-bdcc-4901-a617-193dbc287316 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] 10.222.0.49 "GET /compute/v2.1/servers/dac49498-274f-4b45-ac30-0523cf21ee74" status: 200 len: 1512 microversion: 2.1 time: 0.178768 May 12 14:49:14.893815 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 68/130] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:49:14 2022] GET /compute/v2.1/servers/dac49498-274f-4b45-ac30-0523cf21ee74 => generated 1512 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:49:15.591782 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-5ebaa74d-eada-46de-bab8-5c42a7bd008c tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:15.592432 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-5ebaa74d-eada-46de-bab8-5c42a7bd008c tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 2ce97f89-b3ca-43bc-95bb-fc748d173ed5] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:49:15.599649 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-5ebaa74d-eada-46de-bab8-5c42a7bd008c tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:15.600132 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-5ebaa74d-eada-46de-bab8-5c42a7bd008c tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:15.600914 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-5ebaa74d-eada-46de-bab8-5c42a7bd008c tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:15.601352 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-5ebaa74d-eada-46de-bab8-5c42a7bd008c tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:15.806641 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-5ebaa74d-eada-46de-bab8-5c42a7bd008c tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:15.809189 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-5ebaa74d-eada-46de-bab8-5c42a7bd008c tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/2ce97f89-b3ca-43bc-95bb-fc748d173ed5" status: 200 len: 1521 microversion: 2.1 time: 0.221212 May 12 14:49:15.809772 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 63/131] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:49:15 2022] GET /compute/v2.1/servers/2ce97f89-b3ca-43bc-95bb-fc748d173ed5 => generated 1521 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:49:15.911210 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-3a33c9a0-c84d-4daf-9e1d-d7d2591521e2 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:15.911823 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-3a33c9a0-c84d-4daf-9e1d-d7d2591521e2 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] [instance: dac49498-274f-4b45-ac30-0523cf21ee74] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:49:15.919961 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-3a33c9a0-c84d-4daf-9e1d-d7d2591521e2 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:15.920489 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-3a33c9a0-c84d-4daf-9e1d-d7d2591521e2 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:15.921267 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-3a33c9a0-c84d-4daf-9e1d-d7d2591521e2 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:15.921701 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-3a33c9a0-c84d-4daf-9e1d-d7d2591521e2 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:16.054630 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-3a33c9a0-c84d-4daf-9e1d-d7d2591521e2 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1458fa830b624a1cb64917dc815206ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0fc219e42a416ea2f81435544b43bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:16.063663 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-3a33c9a0-c84d-4daf-9e1d-d7d2591521e2 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] 10.222.0.49 "GET /compute/v2.1/servers/dac49498-274f-4b45-ac30-0523cf21ee74" status: 200 len: 1512 microversion: 2.1 time: 0.156064 May 12 14:49:16.065055 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 69/132] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:49:15 2022] GET /compute/v2.1/servers/dac49498-274f-4b45-ac30-0523cf21ee74 => generated 1512 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:49:16.826403 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-2b40d7bd-feca-409e-8e0e-f803bf325e88 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:16.827051 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-2b40d7bd-feca-409e-8e0e-f803bf325e88 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 2ce97f89-b3ca-43bc-95bb-fc748d173ed5] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:49:16.846634 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-2b40d7bd-feca-409e-8e0e-f803bf325e88 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:16.847552 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-2b40d7bd-feca-409e-8e0e-f803bf325e88 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:16.849061 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-2b40d7bd-feca-409e-8e0e-f803bf325e88 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:16.850066 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-2b40d7bd-feca-409e-8e0e-f803bf325e88 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:17.080951 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-bab20c38-ddf6-44e5-9d4e-f0b69130417f tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:17.081579 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-bab20c38-ddf6-44e5-9d4e-f0b69130417f tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] [instance: dac49498-274f-4b45-ac30-0523cf21ee74] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:49:17.090200 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-bab20c38-ddf6-44e5-9d4e-f0b69130417f tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:17.091018 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-bab20c38-ddf6-44e5-9d4e-f0b69130417f tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:17.092088 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-bab20c38-ddf6-44e5-9d4e-f0b69130417f tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:17.092761 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-bab20c38-ddf6-44e5-9d4e-f0b69130417f tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:17.193353 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-bab20c38-ddf6-44e5-9d4e-f0b69130417f tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:17.193353 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-bab20c38-ddf6-44e5-9d4e-f0b69130417f tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:17.193353 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.objects.instance [None req-bab20c38-ddf6-44e5-9d4e-f0b69130417f tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lazy-loading 'fault' on Instance uuid dac49498-274f-4b45-ac30-0523cf21ee74 {{(pid=102213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 12 14:49:17.297770 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-bab20c38-ddf6-44e5-9d4e-f0b69130417f tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1458fa830b624a1cb64917dc815206ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a0fc219e42a416ea2f81435544b43bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:17.311490 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-bab20c38-ddf6-44e5-9d4e-f0b69130417f tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] 10.222.0.49 "GET /compute/v2.1/servers/dac49498-274f-4b45-ac30-0523cf21ee74" status: 200 len: 1350 microversion: 2.1 time: 0.234178 May 12 14:49:17.319217 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-2b40d7bd-feca-409e-8e0e-f803bf325e88 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:17.319349 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 70/133] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:49:17 2022] GET /compute/v2.1/servers/dac49498-274f-4b45-ac30-0523cf21ee74 => generated 1350 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:49:17.337406 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-2b40d7bd-feca-409e-8e0e-f803bf325e88 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/2ce97f89-b3ca-43bc-95bb-fc748d173ed5" status: 200 len: 1521 microversion: 2.1 time: 0.515834 May 12 14:49:17.345046 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 64/134] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:49:16 2022] GET /compute/v2.1/servers/2ce97f89-b3ca-43bc-95bb-fc748d173ed5 => generated 1521 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:49:18.334643 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-82fd1be4-3670-4881-bf70-9c12bada0d44 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:18.335470 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-82fd1be4-3670-4881-bf70-9c12bada0d44 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] [instance: dac49498-274f-4b45-ac30-0523cf21ee74] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:49:18.343117 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-82fd1be4-3670-4881-bf70-9c12bada0d44 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:18.343563 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-82fd1be4-3670-4881-bf70-9c12bada0d44 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:18.344316 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-82fd1be4-3670-4881-bf70-9c12bada0d44 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:18.344739 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-82fd1be4-3670-4881-bf70-9c12bada0d44 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:18.355626 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-a4f6911e-62b0-430c-a717-7ddd7f1625c0 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:18.356162 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-a4f6911e-62b0-430c-a717-7ddd7f1625c0 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 2ce97f89-b3ca-43bc-95bb-fc748d173ed5] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:49:18.368285 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-a4f6911e-62b0-430c-a717-7ddd7f1625c0 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:18.369026 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-a4f6911e-62b0-430c-a717-7ddd7f1625c0 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:18.370151 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-a4f6911e-62b0-430c-a717-7ddd7f1625c0 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:18.374288 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-a4f6911e-62b0-430c-a717-7ddd7f1625c0 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:18.399284 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.wsgi [None req-82fd1be4-3670-4881-bf70-9c12bada0d44 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] HTTP exception thrown: Instance dac49498-274f-4b45-ac30-0523cf21ee74 could not be found. May 12 14:49:18.399884 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-82fd1be4-3670-4881-bf70-9c12bada0d44 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Returning 404 to user: Instance dac49498-274f-4b45-ac30-0523cf21ee74 could not be found. {{(pid=102213) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 12 14:49:18.401299 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-82fd1be4-3670-4881-bf70-9c12bada0d44 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] 10.222.0.49 "GET /compute/v2.1/servers/dac49498-274f-4b45-ac30-0523cf21ee74" status: 404 len: 111 microversion: 2.1 time: 0.070422 May 12 14:49:18.402939 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 71/135] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:49:18 2022] GET /compute/v2.1/servers/dac49498-274f-4b45-ac30-0523cf21ee74 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 14:49:18.596162 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-0894e73a-dad5-4da0-adc6-fb4cf07e143b tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:18.597091 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-0894e73a-dad5-4da0-adc6-fb4cf07e143b tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] [instance: dac49498-274f-4b45-ac30-0523cf21ee74] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:49:18.604915 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-0894e73a-dad5-4da0-adc6-fb4cf07e143b tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:18.605617 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-0894e73a-dad5-4da0-adc6-fb4cf07e143b tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:18.606445 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-0894e73a-dad5-4da0-adc6-fb4cf07e143b tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:18.607100 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-0894e73a-dad5-4da0-adc6-fb4cf07e143b tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:18.659137 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.wsgi [None req-0894e73a-dad5-4da0-adc6-fb4cf07e143b tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] HTTP exception thrown: Instance dac49498-274f-4b45-ac30-0523cf21ee74 could not be found. May 12 14:49:18.659731 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-0894e73a-dad5-4da0-adc6-fb4cf07e143b tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Returning 404 to user: Instance dac49498-274f-4b45-ac30-0523cf21ee74 could not be found. {{(pid=102213) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 12 14:49:18.660813 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-0894e73a-dad5-4da0-adc6-fb4cf07e143b tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] 10.222.0.49 "GET /compute/v2.1/servers/dac49498-274f-4b45-ac30-0523cf21ee74/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.068777 May 12 14:49:18.664926 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 72/136] 10.222.0.49 () {58 vars in 1301 bytes} [Thu May 12 14:49:18 2022] GET /compute/v2.1/servers/dac49498-274f-4b45-ac30-0523cf21ee74/os-volume_attachments => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 12 14:49:18.683228 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-a4f6911e-62b0-430c-a717-7ddd7f1625c0 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:18.695322 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-a4f6911e-62b0-430c-a717-7ddd7f1625c0 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/2ce97f89-b3ca-43bc-95bb-fc748d173ed5" status: 200 len: 1521 microversion: 2.1 time: 0.343298 May 12 14:49:18.696286 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 65/137] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:49:18 2022] GET /compute/v2.1/servers/2ce97f89-b3ca-43bc-95bb-fc748d173ed5 => generated 1521 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:49:19.713343 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-3eefff0b-0048-4d19-93ab-b30a3e3a9ed3 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:19.713956 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-3eefff0b-0048-4d19-93ab-b30a3e3a9ed3 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 2ce97f89-b3ca-43bc-95bb-fc748d173ed5] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:49:19.721098 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-3eefff0b-0048-4d19-93ab-b30a3e3a9ed3 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:19.721546 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-3eefff0b-0048-4d19-93ab-b30a3e3a9ed3 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:19.722429 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-3eefff0b-0048-4d19-93ab-b30a3e3a9ed3 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:19.722883 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-3eefff0b-0048-4d19-93ab-b30a3e3a9ed3 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:19.934607 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-3eefff0b-0048-4d19-93ab-b30a3e3a9ed3 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:19.943257 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-3eefff0b-0048-4d19-93ab-b30a3e3a9ed3 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/2ce97f89-b3ca-43bc-95bb-fc748d173ed5" status: 200 len: 1521 microversion: 2.1 time: 0.234253 May 12 14:49:19.943951 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 73/138] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:49:19 2022] GET /compute/v2.1/servers/2ce97f89-b3ca-43bc-95bb-fc748d173ed5 => generated 1521 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:49:20.961937 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-4ac736c3-1fd7-4272-be09-84cc67230e34 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:20.962674 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-4ac736c3-1fd7-4272-be09-84cc67230e34 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 2ce97f89-b3ca-43bc-95bb-fc748d173ed5] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:49:20.970290 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-4ac736c3-1fd7-4272-be09-84cc67230e34 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:20.970762 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-4ac736c3-1fd7-4272-be09-84cc67230e34 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:20.971775 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-4ac736c3-1fd7-4272-be09-84cc67230e34 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:20.972211 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-4ac736c3-1fd7-4272-be09-84cc67230e34 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:21.285093 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-4ac736c3-1fd7-4272-be09-84cc67230e34 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:21.294560 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-4ac736c3-1fd7-4272-be09-84cc67230e34 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/2ce97f89-b3ca-43bc-95bb-fc748d173ed5" status: 200 len: 1521 microversion: 2.1 time: 0.337631 May 12 14:49:21.295160 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 66/139] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:49:20 2022] GET /compute/v2.1/servers/2ce97f89-b3ca-43bc-95bb-fc748d173ed5 => generated 1521 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:49:22.311667 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-d9444ac4-2d74-40e1-9d91-6b6da3bb4404 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:22.312654 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-d9444ac4-2d74-40e1-9d91-6b6da3bb4404 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 2ce97f89-b3ca-43bc-95bb-fc748d173ed5] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:49:22.326602 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-d9444ac4-2d74-40e1-9d91-6b6da3bb4404 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:22.327084 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-d9444ac4-2d74-40e1-9d91-6b6da3bb4404 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:22.327852 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-d9444ac4-2d74-40e1-9d91-6b6da3bb4404 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:22.328281 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-d9444ac4-2d74-40e1-9d91-6b6da3bb4404 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:22.403650 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-64a566c6-0c38-4947-b31f-98722fce54bd tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:22.404465 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-64a566c6-0c38-4947-b31f-98722fce54bd tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] [instance: dac49498-274f-4b45-ac30-0523cf21ee74] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:49:22.414288 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-64a566c6-0c38-4947-b31f-98722fce54bd tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:22.414934 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-64a566c6-0c38-4947-b31f-98722fce54bd tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:22.416620 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-64a566c6-0c38-4947-b31f-98722fce54bd tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:22.417178 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-64a566c6-0c38-4947-b31f-98722fce54bd tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:22.471695 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.wsgi [None req-64a566c6-0c38-4947-b31f-98722fce54bd tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] HTTP exception thrown: Instance dac49498-274f-4b45-ac30-0523cf21ee74 could not be found. May 12 14:49:22.472328 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-64a566c6-0c38-4947-b31f-98722fce54bd tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Returning 404 to user: Instance dac49498-274f-4b45-ac30-0523cf21ee74 could not be found. {{(pid=102212) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 12 14:49:22.473178 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-64a566c6-0c38-4947-b31f-98722fce54bd tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] 10.222.0.49 "DELETE /compute/v2.1/servers/dac49498-274f-4b45-ac30-0523cf21ee74" status: 404 len: 111 microversion: 2.1 time: 0.075307 May 12 14:49:22.476876 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 67/140] 10.222.0.49 () {58 vars in 1238 bytes} [Thu May 12 14:49:22 2022] DELETE /compute/v2.1/servers/dac49498-274f-4b45-ac30-0523cf21ee74 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 12 14:49:22.484971 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-a9347298-612c-415f-b08f-def3138534b9 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:22.485777 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-a9347298-612c-415f-b08f-def3138534b9 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] [instance: dac49498-274f-4b45-ac30-0523cf21ee74] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:49:22.493336 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-a9347298-612c-415f-b08f-def3138534b9 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:22.493785 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-a9347298-612c-415f-b08f-def3138534b9 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:22.495201 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-a9347298-612c-415f-b08f-def3138534b9 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:22.495646 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-a9347298-612c-415f-b08f-def3138534b9 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:22.546955 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.wsgi [None req-a9347298-612c-415f-b08f-def3138534b9 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] HTTP exception thrown: Instance dac49498-274f-4b45-ac30-0523cf21ee74 could not be found. May 12 14:49:22.547746 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-a9347298-612c-415f-b08f-def3138534b9 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] Returning 404 to user: Instance dac49498-274f-4b45-ac30-0523cf21ee74 could not be found. {{(pid=102212) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 12 14:49:22.548913 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-a9347298-612c-415f-b08f-def3138534b9 tempest-DeleteServersTestJSON-696306075 tempest-DeleteServersTestJSON-696306075-project] 10.222.0.49 "GET /compute/v2.1/servers/dac49498-274f-4b45-ac30-0523cf21ee74" status: 404 len: 111 microversion: 2.1 time: 0.070884 May 12 14:49:22.549630 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 68/141] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:49:22 2022] GET /compute/v2.1/servers/dac49498-274f-4b45-ac30-0523cf21ee74 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 14:49:22.577964 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-d9444ac4-2d74-40e1-9d91-6b6da3bb4404 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:22.587227 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-d9444ac4-2d74-40e1-9d91-6b6da3bb4404 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/2ce97f89-b3ca-43bc-95bb-fc748d173ed5" status: 200 len: 1521 microversion: 2.1 time: 0.279229 May 12 14:49:22.597833 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 74/142] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:49:22 2022] GET /compute/v2.1/servers/2ce97f89-b3ca-43bc-95bb-fc748d173ed5 => generated 1521 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:49:23.605607 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-55662375-bfe1-4089-acdf-320cc3952047 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:23.606891 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-55662375-bfe1-4089-acdf-320cc3952047 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 2ce97f89-b3ca-43bc-95bb-fc748d173ed5] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:49:23.617679 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-55662375-bfe1-4089-acdf-320cc3952047 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:23.618365 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-55662375-bfe1-4089-acdf-320cc3952047 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:23.619683 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-55662375-bfe1-4089-acdf-320cc3952047 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:23.620338 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-55662375-bfe1-4089-acdf-320cc3952047 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:23.838739 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-55662375-bfe1-4089-acdf-320cc3952047 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:23.847004 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-55662375-bfe1-4089-acdf-320cc3952047 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/2ce97f89-b3ca-43bc-95bb-fc748d173ed5" status: 200 len: 1521 microversion: 2.1 time: 0.245897 May 12 14:49:23.847855 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 69/143] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:49:23 2022] GET /compute/v2.1/servers/2ce97f89-b3ca-43bc-95bb-fc748d173ed5 => generated 1521 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:49:24.867996 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-c60a0762-2203-44e4-9129-c9679a6e36cf tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:24.868603 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-c60a0762-2203-44e4-9129-c9679a6e36cf tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 2ce97f89-b3ca-43bc-95bb-fc748d173ed5] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:49:24.878228 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-c60a0762-2203-44e4-9129-c9679a6e36cf tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:24.878854 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-c60a0762-2203-44e4-9129-c9679a6e36cf tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:24.879626 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-c60a0762-2203-44e4-9129-c9679a6e36cf tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:24.880052 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-c60a0762-2203-44e4-9129-c9679a6e36cf tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:25.128826 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-c60a0762-2203-44e4-9129-c9679a6e36cf tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:25.137679 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-c60a0762-2203-44e4-9129-c9679a6e36cf tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/2ce97f89-b3ca-43bc-95bb-fc748d173ed5" status: 200 len: 1521 microversion: 2.1 time: 0.273380 May 12 14:49:25.138369 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 75/144] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:49:24 2022] GET /compute/v2.1/servers/2ce97f89-b3ca-43bc-95bb-fc748d173ed5 => generated 1521 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:49:26.154754 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-ea71bd03-6667-45e8-b7c5-90b551472a65 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:26.155667 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-ea71bd03-6667-45e8-b7c5-90b551472a65 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 2ce97f89-b3ca-43bc-95bb-fc748d173ed5] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:49:26.164698 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-ea71bd03-6667-45e8-b7c5-90b551472a65 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:26.172084 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-ea71bd03-6667-45e8-b7c5-90b551472a65 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:26.172084 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-ea71bd03-6667-45e8-b7c5-90b551472a65 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:26.172084 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-ea71bd03-6667-45e8-b7c5-90b551472a65 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:26.404128 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-ea71bd03-6667-45e8-b7c5-90b551472a65 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:26.413099 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-ea71bd03-6667-45e8-b7c5-90b551472a65 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/2ce97f89-b3ca-43bc-95bb-fc748d173ed5" status: 200 len: 1521 microversion: 2.1 time: 0.261898 May 12 14:49:26.414203 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 70/145] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:49:26 2022] GET /compute/v2.1/servers/2ce97f89-b3ca-43bc-95bb-fc748d173ed5 => generated 1521 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:49:27.429764 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-c3835fc4-6aff-4af1-9d0a-53c40fca7810 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:27.430548 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-c3835fc4-6aff-4af1-9d0a-53c40fca7810 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 2ce97f89-b3ca-43bc-95bb-fc748d173ed5] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:49:27.448185 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-c3835fc4-6aff-4af1-9d0a-53c40fca7810 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:27.448631 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-c3835fc4-6aff-4af1-9d0a-53c40fca7810 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:27.449624 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-c3835fc4-6aff-4af1-9d0a-53c40fca7810 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:27.450064 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-c3835fc4-6aff-4af1-9d0a-53c40fca7810 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:27.696761 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-c3835fc4-6aff-4af1-9d0a-53c40fca7810 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:27.709091 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-c3835fc4-6aff-4af1-9d0a-53c40fca7810 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/2ce97f89-b3ca-43bc-95bb-fc748d173ed5" status: 200 len: 1521 microversion: 2.1 time: 0.282969 May 12 14:49:27.709680 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 76/146] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:49:27 2022] GET /compute/v2.1/servers/2ce97f89-b3ca-43bc-95bb-fc748d173ed5 => generated 1521 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:49:28.734095 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-28ddd989-2563-4a0a-9da3-88f4ced9e840 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:28.735418 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-28ddd989-2563-4a0a-9da3-88f4ced9e840 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 2ce97f89-b3ca-43bc-95bb-fc748d173ed5] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:49:28.745733 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-28ddd989-2563-4a0a-9da3-88f4ced9e840 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:28.746424 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-28ddd989-2563-4a0a-9da3-88f4ced9e840 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:28.747405 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-28ddd989-2563-4a0a-9da3-88f4ced9e840 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:28.748159 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-28ddd989-2563-4a0a-9da3-88f4ced9e840 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:29.246165 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-28ddd989-2563-4a0a-9da3-88f4ced9e840 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:29.265603 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-28ddd989-2563-4a0a-9da3-88f4ced9e840 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/2ce97f89-b3ca-43bc-95bb-fc748d173ed5" status: 200 len: 1521 microversion: 2.1 time: 0.535383 May 12 14:49:29.271132 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 71/147] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:49:28 2022] GET /compute/v2.1/servers/2ce97f89-b3ca-43bc-95bb-fc748d173ed5 => generated 1521 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:49:30.278425 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-c637cc20-d3c4-4cc6-9851-9ff162d04516 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:30.279216 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-c637cc20-d3c4-4cc6-9851-9ff162d04516 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 2ce97f89-b3ca-43bc-95bb-fc748d173ed5] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:49:30.286709 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-c637cc20-d3c4-4cc6-9851-9ff162d04516 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:30.289741 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-c637cc20-d3c4-4cc6-9851-9ff162d04516 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:30.289741 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-c637cc20-d3c4-4cc6-9851-9ff162d04516 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:30.289741 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-c637cc20-d3c4-4cc6-9851-9ff162d04516 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:30.652497 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-c637cc20-d3c4-4cc6-9851-9ff162d04516 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:30.660406 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-c637cc20-d3c4-4cc6-9851-9ff162d04516 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/2ce97f89-b3ca-43bc-95bb-fc748d173ed5" status: 200 len: 1521 microversion: 2.1 time: 0.385444 May 12 14:49:30.660900 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 77/148] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:49:30 2022] GET /compute/v2.1/servers/2ce97f89-b3ca-43bc-95bb-fc748d173ed5 => generated 1521 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:49:31.678266 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-edd0f2c1-57ee-46f7-baf9-30e034309bc9 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:31.679752 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-edd0f2c1-57ee-46f7-baf9-30e034309bc9 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 2ce97f89-b3ca-43bc-95bb-fc748d173ed5] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:49:31.688639 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-edd0f2c1-57ee-46f7-baf9-30e034309bc9 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:31.689444 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-edd0f2c1-57ee-46f7-baf9-30e034309bc9 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:31.690534 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-edd0f2c1-57ee-46f7-baf9-30e034309bc9 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:31.691340 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-edd0f2c1-57ee-46f7-baf9-30e034309bc9 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:32.175485 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-edd0f2c1-57ee-46f7-baf9-30e034309bc9 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:32.184283 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-edd0f2c1-57ee-46f7-baf9-30e034309bc9 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/2ce97f89-b3ca-43bc-95bb-fc748d173ed5" status: 200 len: 1521 microversion: 2.1 time: 0.510420 May 12 14:49:32.198394 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 72/149] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:49:31 2022] GET /compute/v2.1/servers/2ce97f89-b3ca-43bc-95bb-fc748d173ed5 => generated 1521 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:49:33.208629 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-947e2eb6-cdf7-48d4-b4ef-e7b01bda9d62 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:33.210937 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-947e2eb6-cdf7-48d4-b4ef-e7b01bda9d62 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 2ce97f89-b3ca-43bc-95bb-fc748d173ed5] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:49:33.232880 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-947e2eb6-cdf7-48d4-b4ef-e7b01bda9d62 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:33.233331 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-947e2eb6-cdf7-48d4-b4ef-e7b01bda9d62 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:33.234177 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-947e2eb6-cdf7-48d4-b4ef-e7b01bda9d62 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:33.234629 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-947e2eb6-cdf7-48d4-b4ef-e7b01bda9d62 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:33.505694 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-4b68e0c4-6499-46c1-afb1-a4646e1ead87 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1205087048", "imageRef": "a4587ab2-5f51-46a3-a023-0e6778ccaaa1", "flavorRef": "452", "networks": [{"uuid": "00edf37b-6815-4232-8afc-447b4ec96a1b"}]}} {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:49:33.583153 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.network.neutron [None req-4b68e0c4-6499-46c1-afb1-a4646e1ead87 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] validate_networks() for [('00edf37b-6815-4232-8afc-447b4ec96a1b', None, None, None)] {{(pid=102212) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} May 12 14:49:33.589529 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-947e2eb6-cdf7-48d4-b4ef-e7b01bda9d62 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:33.599456 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-947e2eb6-cdf7-48d4-b4ef-e7b01bda9d62 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/2ce97f89-b3ca-43bc-95bb-fc748d173ed5" status: 200 len: 1521 microversion: 2.1 time: 0.399601 May 12 14:49:33.610289 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 78/150] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:49:33 2022] GET /compute/v2.1/servers/2ce97f89-b3ca-43bc-95bb-fc748d173ed5 => generated 1521 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:49:34.272416 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.virt.hardware [None req-4b68e0c4-6499-46c1-afb1-a4646e1ead87 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Flavor limits 0:0:0 {{(pid=102212) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 14:49:34.272840 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.virt.hardware [None req-4b68e0c4-6499-46c1-afb1-a4646e1ead87 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Image limits 0:0:0 {{(pid=102212) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 14:49:34.273312 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.virt.hardware [None req-4b68e0c4-6499-46c1-afb1-a4646e1ead87 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Flavor pref 0:0:0 {{(pid=102212) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 14:49:34.273715 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.virt.hardware [None req-4b68e0c4-6499-46c1-afb1-a4646e1ead87 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Image pref 0:0:0 {{(pid=102212) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 14:49:34.274303 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.virt.hardware [None req-4b68e0c4-6499-46c1-afb1-a4646e1ead87 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=102212) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 14:49:34.284665 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-4b68e0c4-6499-46c1-afb1-a4646e1ead87 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:34.285112 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-4b68e0c4-6499-46c1-afb1-a4646e1ead87 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:34.285913 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-4b68e0c4-6499-46c1-afb1-a4646e1ead87 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:34.286346 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-4b68e0c4-6499-46c1-afb1-a4646e1ead87 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:34.304701 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.quota [None req-4b68e0c4-6499-46c1-afb1-a4646e1ead87 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Getting quotas for project f9ed089c81294b4981046ede5ed951bd. Resources: {'cores', 'ram', 'instances'} {{(pid=102212) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 12 14:49:34.308744 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.quota [None req-4b68e0c4-6499-46c1-afb1-a4646e1ead87 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Getting quotas for user ab371128e42444f49bc63661feaf7cd8 and project f9ed089c81294b4981046ede5ed951bd. Resources: {'cores', 'ram', 'instances'} {{(pid=102212) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 12 14:49:34.319362 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-4b68e0c4-6499-46c1-afb1-a4646e1ead87 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Going to run 1 instances... {{(pid=102212) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 12 14:49:34.322200 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-4b68e0c4-6499-46c1-afb1-a4646e1ead87 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] [instance: 364ca957-8a0e-45d2-bae2-a850c6708e51] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a4587ab2-5f51-46a3-a023-0e6778ccaaa1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=102212) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} May 12 14:49:34.549399 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-4b68e0c4-6499-46c1-afb1-a4646e1ead87 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.047382 May 12 14:49:34.560577 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-a263c96b-61c7-4afb-ac26-95f8081d89d9 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:34.561865 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-a263c96b-61c7-4afb-ac26-95f8081d89d9 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] [instance: 364ca957-8a0e-45d2-bae2-a850c6708e51] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:49:34.566431 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 73/151] 10.222.0.49 () {60 vars in 1146 bytes} [Thu May 12 14:49:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1065 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 14:49:34.617376 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-51859952-1b87-4a13-bd35-684c933a63f9 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:34.618287 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-51859952-1b87-4a13-bd35-684c933a63f9 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 2ce97f89-b3ca-43bc-95bb-fc748d173ed5] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:49:34.626296 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-51859952-1b87-4a13-bd35-684c933a63f9 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:34.627004 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-51859952-1b87-4a13-bd35-684c933a63f9 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:34.628213 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-51859952-1b87-4a13-bd35-684c933a63f9 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:34.628809 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-51859952-1b87-4a13-bd35-684c933a63f9 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:34.673759 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-a263c96b-61c7-4afb-ac26-95f8081d89d9 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab371128e42444f49bc63661feaf7cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ed089c81294b4981046ede5ed951bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:34.683869 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-a263c96b-61c7-4afb-ac26-95f8081d89d9 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] 10.222.0.49 "GET /compute/v2.1/servers/364ca957-8a0e-45d2-bae2-a850c6708e51" status: 200 len: 1219 microversion: 2.1 time: 0.127585 May 12 14:49:34.695182 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 79/152] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:49:34 2022] GET /compute/v2.1/servers/364ca957-8a0e-45d2-bae2-a850c6708e51 => generated 1219 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:49:34.902909 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-51859952-1b87-4a13-bd35-684c933a63f9 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:34.910264 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-51859952-1b87-4a13-bd35-684c933a63f9 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/2ce97f89-b3ca-43bc-95bb-fc748d173ed5" status: 200 len: 1521 microversion: 2.1 time: 0.296541 May 12 14:49:34.910844 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 74/153] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:49:34 2022] GET /compute/v2.1/servers/2ce97f89-b3ca-43bc-95bb-fc748d173ed5 => generated 1521 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:49:35.704784 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-8bfc2896-1b5e-46e4-aaf5-777fc2842e52 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:35.705817 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-8bfc2896-1b5e-46e4-aaf5-777fc2842e52 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] [instance: 364ca957-8a0e-45d2-bae2-a850c6708e51] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:49:35.805355 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-8bfc2896-1b5e-46e4-aaf5-777fc2842e52 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab371128e42444f49bc63661feaf7cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ed089c81294b4981046ede5ed951bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:35.813704 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-8bfc2896-1b5e-46e4-aaf5-777fc2842e52 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] 10.222.0.49 "GET /compute/v2.1/servers/364ca957-8a0e-45d2-bae2-a850c6708e51" status: 200 len: 1219 microversion: 2.1 time: 0.115379 May 12 14:49:35.814594 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 80/154] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:49:35 2022] GET /compute/v2.1/servers/364ca957-8a0e-45d2-bae2-a850c6708e51 => generated 1219 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:49:35.928658 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-44e009fc-9c1a-4f4e-8005-da858a13e369 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:35.929452 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-44e009fc-9c1a-4f4e-8005-da858a13e369 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 2ce97f89-b3ca-43bc-95bb-fc748d173ed5] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:49:35.940957 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-44e009fc-9c1a-4f4e-8005-da858a13e369 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:35.941738 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-44e009fc-9c1a-4f4e-8005-da858a13e369 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:35.942935 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-44e009fc-9c1a-4f4e-8005-da858a13e369 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:35.943712 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-44e009fc-9c1a-4f4e-8005-da858a13e369 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:36.112470 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-8cee69b9-a65f-4db4-ad9b-145baef66d55 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Action: 'create', calling method: .version_select at 0x7ff77fbf6310>, body: {"keypair": {"name": "tempest-keypair-1383614298", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLJhlorHwKbmqKpPMSdf0YtMPXSW422eh7Q37PWlYuiuKwRisrm9KA/LjuCB9c7jVKJ+40aj7ESZKGDq+vDk0P6Y5aqahQRzPG1Ccbwupq17+Mszdn/l//1G7i3kx+X2Bg=="}} {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:49:36.137809 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.quota [None req-8cee69b9-a65f-4db4-ad9b-145baef66d55 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Getting quotas for project 5a45a5191eca43c2b8d3e9ea80a50b5e. Resources: {'key_pairs'} {{(pid=102213) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 12 14:49:36.141911 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.quota [None req-8cee69b9-a65f-4db4-ad9b-145baef66d55 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Getting quotas for user 4214f9e24bfa4f25ae9efbb7fa909300 and project 5a45a5191eca43c2b8d3e9ea80a50b5e. Resources: {'key_pairs'} {{(pid=102213) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 12 14:49:36.149095 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-44e009fc-9c1a-4f4e-8005-da858a13e369 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:36.158187 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-44e009fc-9c1a-4f4e-8005-da858a13e369 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/2ce97f89-b3ca-43bc-95bb-fc748d173ed5" status: 200 len: 1521 microversion: 2.1 time: 0.233736 May 12 14:49:36.159837 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 75/155] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:49:35 2022] GET /compute/v2.1/servers/2ce97f89-b3ca-43bc-95bb-fc748d173ed5 => generated 1521 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:49:36.236076 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-8cee69b9-a65f-4db4-ad9b-145baef66d55 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.245188 May 12 14:49:36.237201 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 81/156] 10.222.0.49 () {62 vars in 1199 bytes} [Thu May 12 14:49:35 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 247 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) May 12 14:49:36.831394 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-9db8a5a3-c695-4bd2-9453-b38246a2b8c3 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:36.832006 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-9db8a5a3-c695-4bd2-9453-b38246a2b8c3 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] [instance: 364ca957-8a0e-45d2-bae2-a850c6708e51] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:49:36.840392 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-9db8a5a3-c695-4bd2-9453-b38246a2b8c3 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:36.840843 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-9db8a5a3-c695-4bd2-9453-b38246a2b8c3 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:36.841617 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-9db8a5a3-c695-4bd2-9453-b38246a2b8c3 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:36.842052 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-9db8a5a3-c695-4bd2-9453-b38246a2b8c3 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:36.986646 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-9db8a5a3-c695-4bd2-9453-b38246a2b8c3 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab371128e42444f49bc63661feaf7cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ed089c81294b4981046ede5ed951bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:36.995352 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-9db8a5a3-c695-4bd2-9453-b38246a2b8c3 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] 10.222.0.49 "GET /compute/v2.1/servers/364ca957-8a0e-45d2-bae2-a850c6708e51" status: 200 len: 1223 microversion: 2.1 time: 0.168109 May 12 14:49:36.996082 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 76/157] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:49:36 2022] GET /compute/v2.1/servers/364ca957-8a0e-45d2-bae2-a850c6708e51 => generated 1223 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:49:37.175445 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-1275d2bb-a66f-455c-b166-d47d1e123164 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:37.176673 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-1275d2bb-a66f-455c-b166-d47d1e123164 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 2ce97f89-b3ca-43bc-95bb-fc748d173ed5] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:49:37.184689 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-1275d2bb-a66f-455c-b166-d47d1e123164 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:37.185404 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-1275d2bb-a66f-455c-b166-d47d1e123164 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:37.186436 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-1275d2bb-a66f-455c-b166-d47d1e123164 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:37.187136 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-1275d2bb-a66f-455c-b166-d47d1e123164 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:37.504192 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-1275d2bb-a66f-455c-b166-d47d1e123164 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:37.517645 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-1275d2bb-a66f-455c-b166-d47d1e123164 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/2ce97f89-b3ca-43bc-95bb-fc748d173ed5" status: 200 len: 1521 microversion: 2.1 time: 0.345829 May 12 14:49:37.519710 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 82/158] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:49:37 2022] GET /compute/v2.1/servers/2ce97f89-b3ca-43bc-95bb-fc748d173ed5 => generated 1521 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:49:38.014080 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-7d09bec2-3c7b-4107-8d6c-edbf8ed31408 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:38.016827 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-7d09bec2-3c7b-4107-8d6c-edbf8ed31408 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] [instance: 364ca957-8a0e-45d2-bae2-a850c6708e51] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:49:38.031606 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-7d09bec2-3c7b-4107-8d6c-edbf8ed31408 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:38.033058 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-7d09bec2-3c7b-4107-8d6c-edbf8ed31408 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:38.034016 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-7d09bec2-3c7b-4107-8d6c-edbf8ed31408 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:38.034608 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-7d09bec2-3c7b-4107-8d6c-edbf8ed31408 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:38.166233 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-7d09bec2-3c7b-4107-8d6c-edbf8ed31408 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab371128e42444f49bc63661feaf7cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ed089c81294b4981046ede5ed951bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:38.176716 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-7d09bec2-3c7b-4107-8d6c-edbf8ed31408 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] 10.222.0.49 "GET /compute/v2.1/servers/364ca957-8a0e-45d2-bae2-a850c6708e51" status: 200 len: 1271 microversion: 2.1 time: 0.166240 May 12 14:49:38.179252 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 77/159] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:49:38 2022] GET /compute/v2.1/servers/364ca957-8a0e-45d2-bae2-a850c6708e51 => generated 1271 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:49:38.544945 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-438a3de1-d545-4ef3-a409-7b58d6c3e081 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:38.546461 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-438a3de1-d545-4ef3-a409-7b58d6c3e081 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 2ce97f89-b3ca-43bc-95bb-fc748d173ed5] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:49:38.562676 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-438a3de1-d545-4ef3-a409-7b58d6c3e081 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:38.563524 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-438a3de1-d545-4ef3-a409-7b58d6c3e081 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:38.566835 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-438a3de1-d545-4ef3-a409-7b58d6c3e081 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:38.567449 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-438a3de1-d545-4ef3-a409-7b58d6c3e081 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:39.007133 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-438a3de1-d545-4ef3-a409-7b58d6c3e081 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:39.019345 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-438a3de1-d545-4ef3-a409-7b58d6c3e081 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/2ce97f89-b3ca-43bc-95bb-fc748d173ed5" status: 200 len: 1501 microversion: 2.1 time: 0.487121 May 12 14:49:39.020632 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 83/160] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:49:38 2022] GET /compute/v2.1/servers/2ce97f89-b3ca-43bc-95bb-fc748d173ed5 => generated 1501 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:49:39.040571 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-4a171f04-c554-4a58-a498-680f57a1deba tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:39.041171 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-4a171f04-c554-4a58-a498-680f57a1deba tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:49:39.065262 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-4a171f04-c554-4a58-a498-680f57a1deba tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:39.070224 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-4a171f04-c554-4a58-a498-680f57a1deba tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:39.071138 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-4a171f04-c554-4a58-a498-680f57a1deba tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:39.071607 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-4a171f04-c554-4a58-a498-680f57a1deba tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:39.196191 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-3dc5f015-751c-4f44-b7e4-7bcb97d433f2 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:39.198903 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-3dc5f015-751c-4f44-b7e4-7bcb97d433f2 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] [instance: 364ca957-8a0e-45d2-bae2-a850c6708e51] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:49:39.223467 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-3dc5f015-751c-4f44-b7e4-7bcb97d433f2 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:39.226310 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-3dc5f015-751c-4f44-b7e4-7bcb97d433f2 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:39.228568 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-3dc5f015-751c-4f44-b7e4-7bcb97d433f2 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:39.232953 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-3dc5f015-751c-4f44-b7e4-7bcb97d433f2 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:39.464648 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-4a171f04-c554-4a58-a498-680f57a1deba tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:39.475316 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-4a171f04-c554-4a58-a498-680f57a1deba tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1" status: 200 len: 1515 microversion: 2.1 time: 0.438827 May 12 14:49:39.476560 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 78/161] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:49:39 2022] GET /compute/v2.1/servers/d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1 => generated 1515 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:49:39.517292 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-3dc5f015-751c-4f44-b7e4-7bcb97d433f2 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab371128e42444f49bc63661feaf7cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ed089c81294b4981046ede5ed951bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:39.530868 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-3dc5f015-751c-4f44-b7e4-7bcb97d433f2 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] 10.222.0.49 "GET /compute/v2.1/servers/364ca957-8a0e-45d2-bae2-a850c6708e51" status: 200 len: 1289 microversion: 2.1 time: 0.337510 May 12 14:49:39.533200 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 84/162] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:49:39 2022] GET /compute/v2.1/servers/364ca957-8a0e-45d2-bae2-a850c6708e51 => generated 1289 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:49:39.730525 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-cbfa446d-50d0-41c9-8744-654da71da877 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-782438806", "imageRef": "a4587ab2-5f51-46a3-a023-0e6778ccaaa1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "741e2b09-db65-4b92-97d4-0a9b29ee4ecf"}], "security_groups": [{"name": "tempest-securitygroup--1603235434"}], "key_name": "tempest-keypair-1383614298", "user_data": "}} {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:49:39.972242 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.network.neutron [None req-cbfa446d-50d0-41c9-8744-654da71da877 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] validate_networks() for [('741e2b09-db65-4b92-97d4-0a9b29ee4ecf', None, None, None)] {{(pid=102212) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} May 12 14:49:40.549675 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-f42ec066-5c26-489d-84ff-647a180b3e3f tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:40.550914 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-f42ec066-5c26-489d-84ff-647a180b3e3f tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] [instance: 364ca957-8a0e-45d2-bae2-a850c6708e51] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:49:40.560212 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-f42ec066-5c26-489d-84ff-647a180b3e3f tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:40.560667 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-f42ec066-5c26-489d-84ff-647a180b3e3f tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:40.561446 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-f42ec066-5c26-489d-84ff-647a180b3e3f tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:40.561882 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-f42ec066-5c26-489d-84ff-647a180b3e3f tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:40.919216 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-f42ec066-5c26-489d-84ff-647a180b3e3f tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab371128e42444f49bc63661feaf7cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ed089c81294b4981046ede5ed951bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:40.930135 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-f42ec066-5c26-489d-84ff-647a180b3e3f tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] 10.222.0.49 "GET /compute/v2.1/servers/364ca957-8a0e-45d2-bae2-a850c6708e51" status: 200 len: 1319 microversion: 2.1 time: 0.384186 May 12 14:49:40.933189 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 85/163] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:49:40 2022] GET /compute/v2.1/servers/364ca957-8a0e-45d2-bae2-a850c6708e51 => generated 1319 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:49:40.971969 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.virt.hardware [None req-cbfa446d-50d0-41c9-8744-654da71da877 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Flavor limits 0:0:0 {{(pid=102212) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 14:49:40.973128 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.virt.hardware [None req-cbfa446d-50d0-41c9-8744-654da71da877 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Image limits 0:0:0 {{(pid=102212) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 14:49:40.973609 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.virt.hardware [None req-cbfa446d-50d0-41c9-8744-654da71da877 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Flavor pref 0:0:0 {{(pid=102212) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 14:49:40.974021 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.virt.hardware [None req-cbfa446d-50d0-41c9-8744-654da71da877 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Image pref 0:0:0 {{(pid=102212) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 14:49:40.974471 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.virt.hardware [None req-cbfa446d-50d0-41c9-8744-654da71da877 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=102212) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 14:49:40.983592 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-cbfa446d-50d0-41c9-8744-654da71da877 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:40.984106 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-cbfa446d-50d0-41c9-8744-654da71da877 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:40.984970 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-cbfa446d-50d0-41c9-8744-654da71da877 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:40.985520 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-cbfa446d-50d0-41c9-8744-654da71da877 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:41.003175 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.quota [None req-cbfa446d-50d0-41c9-8744-654da71da877 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Getting quotas for project 5a45a5191eca43c2b8d3e9ea80a50b5e. Resources: {'cores', 'ram', 'instances'} {{(pid=102212) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 12 14:49:41.007282 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.quota [None req-cbfa446d-50d0-41c9-8744-654da71da877 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Getting quotas for user 4214f9e24bfa4f25ae9efbb7fa909300 and project 5a45a5191eca43c2b8d3e9ea80a50b5e. Resources: {'cores', 'ram', 'instances'} {{(pid=102212) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 12 14:49:41.019030 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-cbfa446d-50d0-41c9-8744-654da71da877 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Going to run 1 instances... {{(pid=102212) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 12 14:49:41.021215 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-cbfa446d-50d0-41c9-8744-654da71da877 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a4587ab2-5f51-46a3-a023-0e6778ccaaa1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=102212) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} May 12 14:49:41.185763 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-cbfa446d-50d0-41c9-8744-654da71da877 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.460325 May 12 14:49:41.188162 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 79/164] 10.222.0.49 () {62 vars in 1187 bytes} [Thu May 12 14:49:39 2022] POST /compute/v2.1/servers => generated 402 bytes in 1464 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 12 14:49:41.198302 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-d101f88d-f349-44a7-a455-a06b131cf10e tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:41.199339 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-d101f88d-f349-44a7-a455-a06b131cf10e tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:49:41.419656 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-d101f88d-f349-44a7-a455-a06b131cf10e tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:41.428366 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-d101f88d-f349-44a7-a455-a06b131cf10e tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:41.429963 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-d101f88d-f349-44a7-a455-a06b131cf10e tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:41.431723 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-d101f88d-f349-44a7-a455-a06b131cf10e tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9" status: 200 len: 1281 microversion: 2.20 time: 0.236990 May 12 14:49:41.432270 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 86/165] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:49:41 2022] GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9 => generated 1281 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:49:41.949934 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-bdd053ab-bd61-4fbe-8266-84da4bcce514 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:41.951708 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-bdd053ab-bd61-4fbe-8266-84da4bcce514 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] [instance: 364ca957-8a0e-45d2-bae2-a850c6708e51] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:49:41.959737 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-bdd053ab-bd61-4fbe-8266-84da4bcce514 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:41.960268 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-bdd053ab-bd61-4fbe-8266-84da4bcce514 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:41.961163 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-bdd053ab-bd61-4fbe-8266-84da4bcce514 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:41.961709 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-bdd053ab-bd61-4fbe-8266-84da4bcce514 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:41.975224 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-af7d4f15-4317-4ea2-913d-9d71501e6025 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:49:41.976303 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-af7d4f15-4317-4ea2-913d-9d71501e6025 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:49:41.984034 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-af7d4f15-4317-4ea2-913d-9d71501e6025 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:41.984540 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-af7d4f15-4317-4ea2-913d-9d71501e6025 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:41.985320 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-af7d4f15-4317-4ea2-913d-9d71501e6025 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:41.985762 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-af7d4f15-4317-4ea2-913d-9d71501e6025 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:42.050369 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.objects.instance [None req-af7d4f15-4317-4ea2-913d-9d71501e6025 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lazy-loading 'flavor' on Instance uuid d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1 {{(pid=102213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 12 14:49:42.441775 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-bdd053ab-bd61-4fbe-8266-84da4bcce514 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab371128e42444f49bc63661feaf7cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ed089c81294b4981046ede5ed951bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:42.451399 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-bdd053ab-bd61-4fbe-8266-84da4bcce514 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] 10.222.0.49 "GET /compute/v2.1/servers/364ca957-8a0e-45d2-bae2-a850c6708e51" status: 200 len: 1319 microversion: 2.1 time: 0.505763 May 12 14:49:42.451969 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 80/166] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:49:41 2022] GET /compute/v2.1/servers/364ca957-8a0e-45d2-bae2-a850c6708e51 => generated 1319 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:49:42.466192 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [req-829788ca-6011-4479-afc2-c7d569f02e3e req-a3137620-34d5-465c-8864-a7309854ebd7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "364ca957-8a0e-45d2-bae2-a850c6708e51", "tag": "38f74632-a3ba-4b81-ac52-5f899e88b5f7"}]} {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:49:42.467767 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:49:42.467767 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: warnings.warn(msg) May 12 14:49:42.475889 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [req-829788ca-6011-4479-afc2-c7d569f02e3e req-a3137620-34d5-465c-8864-a7309854ebd7 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:42.476318 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [req-829788ca-6011-4479-afc2-c7d569f02e3e req-a3137620-34d5-465c-8864-a7309854ebd7 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:42.492234 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.compute.server_external_events [req-829788ca-6011-4479-afc2-c7d569f02e3e req-a3137620-34d5-465c-8864-a7309854ebd7 service nova] Creating event network-changed:38f74632-a3ba-4b81-ac52-5f899e88b5f7 for instance 364ca957-8a0e-45d2-bae2-a850c6708e51 on hv-cinder-83118 May 12 14:49:42.497114 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [req-829788ca-6011-4479-afc2-c7d569f02e3e req-a3137620-34d5-465c-8864-a7309854ebd7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035052 May 12 14:49:42.497736 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 81/167] 10.222.0.49 () {64 vars in 1317 bytes} [Thu May 12 14:49:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:49:42.502902 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-794b9ed3-9f51-443e-8e22-98b20874bc48 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:42.503587 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-794b9ed3-9f51-443e-8e22-98b20874bc48 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:49:42.511778 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-794b9ed3-9f51-443e-8e22-98b20874bc48 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:42.512231 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-794b9ed3-9f51-443e-8e22-98b20874bc48 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:42.512997 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-794b9ed3-9f51-443e-8e22-98b20874bc48 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:42.513584 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-794b9ed3-9f51-443e-8e22-98b20874bc48 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:42.565072 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-af7d4f15-4317-4ea2-913d-9d71501e6025 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "POST /compute/v2.1/servers/d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1/action" status: 200 len: 32 microversion: 2.1 time: 0.593608 May 12 14:49:42.569038 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 87/168] 10.222.0.49 () {60 vars in 1277 bytes} [Thu May 12 14:49:41 2022] POST /compute/v2.1/servers/d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1/action => generated 32 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 12 14:49:42.587163 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-a72ededd-17f8-4399-b45e-48480a487b38 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:42.588066 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-a72ededd-17f8-4399-b45e-48480a487b38 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:49:42.596399 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-a72ededd-17f8-4399-b45e-48480a487b38 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:42.597001 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-a72ededd-17f8-4399-b45e-48480a487b38 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:42.597933 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-a72ededd-17f8-4399-b45e-48480a487b38 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:42.598617 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-a72ededd-17f8-4399-b45e-48480a487b38 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:42.666104 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-794b9ed3-9f51-443e-8e22-98b20874bc48 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:42.678327 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-794b9ed3-9f51-443e-8e22-98b20874bc48 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:42.679905 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-794b9ed3-9f51-443e-8e22-98b20874bc48 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:42.681727 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-794b9ed3-9f51-443e-8e22-98b20874bc48 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9" status: 200 len: 1285 microversion: 2.20 time: 0.182149 May 12 14:49:42.682289 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 82/169] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:49:42 2022] GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9 => generated 1285 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:49:42.822947 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-a72ededd-17f8-4399-b45e-48480a487b38 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:42.832280 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-a72ededd-17f8-4399-b45e-48480a487b38 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1" status: 200 len: 1521 microversion: 2.1 time: 0.251543 May 12 14:49:42.833251 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 88/170] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:49:42 2022] GET /compute/v2.1/servers/d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1 => generated 1521 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:49:43.470950 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-07fcc712-00ab-4c1f-83c1-1c4d8d5ea8e5 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:43.472378 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-07fcc712-00ab-4c1f-83c1-1c4d8d5ea8e5 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] [instance: 364ca957-8a0e-45d2-bae2-a850c6708e51] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:49:43.480924 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-07fcc712-00ab-4c1f-83c1-1c4d8d5ea8e5 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:43.485706 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-07fcc712-00ab-4c1f-83c1-1c4d8d5ea8e5 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:43.487478 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-07fcc712-00ab-4c1f-83c1-1c4d8d5ea8e5 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:43.494025 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-07fcc712-00ab-4c1f-83c1-1c4d8d5ea8e5 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:43.699691 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-c64e7eac-6a43-44a2-9cd8-d3dbe5534f2d tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:43.700328 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-c64e7eac-6a43-44a2-9cd8-d3dbe5534f2d tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:49:43.708407 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-c64e7eac-6a43-44a2-9cd8-d3dbe5534f2d tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:43.709114 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-c64e7eac-6a43-44a2-9cd8-d3dbe5534f2d tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:43.710074 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-c64e7eac-6a43-44a2-9cd8-d3dbe5534f2d tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:43.710506 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-c64e7eac-6a43-44a2-9cd8-d3dbe5534f2d tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:43.834284 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-c64e7eac-6a43-44a2-9cd8-d3dbe5534f2d tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:43.843443 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-c64e7eac-6a43-44a2-9cd8-d3dbe5534f2d tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:43.845255 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-c64e7eac-6a43-44a2-9cd8-d3dbe5534f2d tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:43.846378 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-c64e7eac-6a43-44a2-9cd8-d3dbe5534f2d tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9" status: 200 len: 1333 microversion: 2.20 time: 0.150549 May 12 14:49:43.846979 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 89/171] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:49:43 2022] GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9 => generated 1333 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 14:49:43.851242 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-d3b736e1-1f50-49ff-8eb4-df26b0155e3b tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:43.851845 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-d3b736e1-1f50-49ff-8eb4-df26b0155e3b tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:49:43.859945 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-d3b736e1-1f50-49ff-8eb4-df26b0155e3b tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:43.864113 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-d3b736e1-1f50-49ff-8eb4-df26b0155e3b tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:43.864113 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-d3b736e1-1f50-49ff-8eb4-df26b0155e3b tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:43.864113 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-d3b736e1-1f50-49ff-8eb4-df26b0155e3b tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:44.140023 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-07fcc712-00ab-4c1f-83c1-1c4d8d5ea8e5 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab371128e42444f49bc63661feaf7cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ed089c81294b4981046ede5ed951bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:44.155728 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-07fcc712-00ab-4c1f-83c1-1c4d8d5ea8e5 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] 10.222.0.49 "GET /compute/v2.1/servers/364ca957-8a0e-45d2-bae2-a850c6708e51" status: 200 len: 1319 microversion: 2.1 time: 0.688616 May 12 14:49:44.157046 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 83/172] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:49:43 2022] GET /compute/v2.1/servers/364ca957-8a0e-45d2-bae2-a850c6708e51 => generated 1319 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:49:44.416707 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-d3b736e1-1f50-49ff-8eb4-df26b0155e3b tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:44.431670 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-d3b736e1-1f50-49ff-8eb4-df26b0155e3b tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1" status: 200 len: 1521 microversion: 2.1 time: 0.582945 May 12 14:49:44.432557 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 90/173] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:49:43 2022] GET /compute/v2.1/servers/d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1 => generated 1521 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:49:44.872305 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-ea820719-321d-4bfc-b6c6-9829d6620317 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:44.872915 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-ea820719-321d-4bfc-b6c6-9829d6620317 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:49:44.880507 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-ea820719-321d-4bfc-b6c6-9829d6620317 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:44.880965 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-ea820719-321d-4bfc-b6c6-9829d6620317 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:44.881775 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-ea820719-321d-4bfc-b6c6-9829d6620317 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:44.882214 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-ea820719-321d-4bfc-b6c6-9829d6620317 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:45.056780 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-ea820719-321d-4bfc-b6c6-9829d6620317 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:45.070350 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-ea820719-321d-4bfc-b6c6-9829d6620317 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:45.081610 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-ea820719-321d-4bfc-b6c6-9829d6620317 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:45.083876 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-ea820719-321d-4bfc-b6c6-9829d6620317 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9" status: 200 len: 1339 microversion: 2.20 time: 0.215818 May 12 14:49:45.085073 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 84/174] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:49:44 2022] GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9 => generated 1339 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:49:45.172999 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-b9d7e367-59ae-4ce8-abb1-3daae4501b36 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:45.173608 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-b9d7e367-59ae-4ce8-abb1-3daae4501b36 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] [instance: 364ca957-8a0e-45d2-bae2-a850c6708e51] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:49:45.182055 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-b9d7e367-59ae-4ce8-abb1-3daae4501b36 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:45.182499 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-b9d7e367-59ae-4ce8-abb1-3daae4501b36 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:45.183293 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-b9d7e367-59ae-4ce8-abb1-3daae4501b36 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:45.183723 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-b9d7e367-59ae-4ce8-abb1-3daae4501b36 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:45.418132 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-b9d7e367-59ae-4ce8-abb1-3daae4501b36 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab371128e42444f49bc63661feaf7cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ed089c81294b4981046ede5ed951bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:45.428425 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-b9d7e367-59ae-4ce8-abb1-3daae4501b36 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] 10.222.0.49 "GET /compute/v2.1/servers/364ca957-8a0e-45d2-bae2-a850c6708e51" status: 200 len: 1319 microversion: 2.1 time: 0.259137 May 12 14:49:45.428990 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 91/175] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:49:45 2022] GET /compute/v2.1/servers/364ca957-8a0e-45d2-bae2-a850c6708e51 => generated 1319 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:49:45.449373 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-bb4e04fc-6fbe-4a2b-af72-22e1402e6156 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:45.449968 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-bb4e04fc-6fbe-4a2b-af72-22e1402e6156 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:49:45.457419 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-bb4e04fc-6fbe-4a2b-af72-22e1402e6156 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:45.457873 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-bb4e04fc-6fbe-4a2b-af72-22e1402e6156 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:45.458654 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-bb4e04fc-6fbe-4a2b-af72-22e1402e6156 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:45.459119 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-bb4e04fc-6fbe-4a2b-af72-22e1402e6156 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:45.752778 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-bb4e04fc-6fbe-4a2b-af72-22e1402e6156 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:45.772856 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-bb4e04fc-6fbe-4a2b-af72-22e1402e6156 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1" status: 200 len: 1521 microversion: 2.1 time: 0.327074 May 12 14:49:45.782476 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 85/176] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:49:45 2022] GET /compute/v2.1/servers/d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1 => generated 1521 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:49:46.106055 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-d61f40c4-3bcd-496b-8472-d12a0b67d54c tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:46.112046 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-d61f40c4-3bcd-496b-8472-d12a0b67d54c tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:49:46.122269 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-d61f40c4-3bcd-496b-8472-d12a0b67d54c tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:46.124159 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-d61f40c4-3bcd-496b-8472-d12a0b67d54c tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:46.124159 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-d61f40c4-3bcd-496b-8472-d12a0b67d54c tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:46.124159 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-d61f40c4-3bcd-496b-8472-d12a0b67d54c tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:46.446485 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-7129306c-a906-4766-a1f0-96f77681b8f4 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:46.447699 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-7129306c-a906-4766-a1f0-96f77681b8f4 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] [instance: 364ca957-8a0e-45d2-bae2-a850c6708e51] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:49:46.458801 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-7129306c-a906-4766-a1f0-96f77681b8f4 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:46.464106 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-7129306c-a906-4766-a1f0-96f77681b8f4 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:46.465199 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-7129306c-a906-4766-a1f0-96f77681b8f4 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:46.469914 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-7129306c-a906-4766-a1f0-96f77681b8f4 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:46.625044 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-d61f40c4-3bcd-496b-8472-d12a0b67d54c tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:46.638392 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-d61f40c4-3bcd-496b-8472-d12a0b67d54c tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:46.640064 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-d61f40c4-3bcd-496b-8472-d12a0b67d54c tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:46.641171 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-d61f40c4-3bcd-496b-8472-d12a0b67d54c tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9" status: 200 len: 1407 microversion: 2.20 time: 0.540355 May 12 14:49:46.641737 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 92/177] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:49:46 2022] GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9 => generated 1407 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:49:46.793881 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-603ecb07-8832-4a7a-abc3-d1249caaf8e9 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:46.794775 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-603ecb07-8832-4a7a-abc3-d1249caaf8e9 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:49:46.805676 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-603ecb07-8832-4a7a-abc3-d1249caaf8e9 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:46.806903 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-603ecb07-8832-4a7a-abc3-d1249caaf8e9 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:46.809154 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-603ecb07-8832-4a7a-abc3-d1249caaf8e9 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:46.809596 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-603ecb07-8832-4a7a-abc3-d1249caaf8e9 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:46.815520 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-7129306c-a906-4766-a1f0-96f77681b8f4 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab371128e42444f49bc63661feaf7cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ed089c81294b4981046ede5ed951bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:46.832603 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-7129306c-a906-4766-a1f0-96f77681b8f4 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] 10.222.0.49 "GET /compute/v2.1/servers/364ca957-8a0e-45d2-bae2-a850c6708e51" status: 200 len: 1319 microversion: 2.1 time: 0.389765 May 12 14:49:46.833990 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 86/178] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:49:46 2022] GET /compute/v2.1/servers/364ca957-8a0e-45d2-bae2-a850c6708e51 => generated 1319 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:49:47.068894 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-603ecb07-8832-4a7a-abc3-d1249caaf8e9 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:47.080948 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-603ecb07-8832-4a7a-abc3-d1249caaf8e9 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1" status: 200 len: 1521 microversion: 2.1 time: 0.291106 May 12 14:49:47.084650 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 93/179] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:49:46 2022] GET /compute/v2.1/servers/d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1 => generated 1521 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:49:47.663244 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-238eb38f-2bf7-497d-b340-3ddc702d5972 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:47.664604 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-238eb38f-2bf7-497d-b340-3ddc702d5972 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:49:47.674311 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-238eb38f-2bf7-497d-b340-3ddc702d5972 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:47.675368 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-238eb38f-2bf7-497d-b340-3ddc702d5972 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:47.676595 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-238eb38f-2bf7-497d-b340-3ddc702d5972 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:47.677418 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-238eb38f-2bf7-497d-b340-3ddc702d5972 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:47.849545 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-131c109e-f37b-4481-939b-b497f06a82e6 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:47.850147 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-131c109e-f37b-4481-939b-b497f06a82e6 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] [instance: 364ca957-8a0e-45d2-bae2-a850c6708e51] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:49:47.858581 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-131c109e-f37b-4481-939b-b497f06a82e6 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:47.859084 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-131c109e-f37b-4481-939b-b497f06a82e6 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:47.860049 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-131c109e-f37b-4481-939b-b497f06a82e6 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:47.860479 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-131c109e-f37b-4481-939b-b497f06a82e6 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:48.123728 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-238eb38f-2bf7-497d-b340-3ddc702d5972 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:48.134907 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-238eb38f-2bf7-497d-b340-3ddc702d5972 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:48.146678 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-238eb38f-2bf7-497d-b340-3ddc702d5972 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:48.162397 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-238eb38f-2bf7-497d-b340-3ddc702d5972 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9" status: 200 len: 1407 microversion: 2.20 time: 0.493534 May 12 14:49:48.162397 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 87/180] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:49:47 2022] GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9 => generated 1407 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:49:48.171524 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [req-db429f6d-11e0-46c9-8e81-675c7ce9e55d req-53a9ec8e-80ef-4f05-8e0a-690545af224c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9", "tag": "892fd785-17e4-4442-9f7d-2e5d18b22e9f"}]} {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:49:48.173232 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:49:48.173232 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: warnings.warn(msg) May 12 14:49:48.192591 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [req-db429f6d-11e0-46c9-8e81-675c7ce9e55d req-53a9ec8e-80ef-4f05-8e0a-690545af224c service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:48.193033 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [req-db429f6d-11e0-46c9-8e81-675c7ce9e55d req-53a9ec8e-80ef-4f05-8e0a-690545af224c service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:48.241877 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-131c109e-f37b-4481-939b-b497f06a82e6 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab371128e42444f49bc63661feaf7cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ed089c81294b4981046ede5ed951bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:48.243189 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.compute.server_external_events [req-db429f6d-11e0-46c9-8e81-675c7ce9e55d req-53a9ec8e-80ef-4f05-8e0a-690545af224c service nova] Creating event network-changed:892fd785-17e4-4442-9f7d-2e5d18b22e9f for instance a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9 on hv-cinder-83118 May 12 14:49:48.252337 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [req-db429f6d-11e0-46c9-8e81-675c7ce9e55d req-53a9ec8e-80ef-4f05-8e0a-690545af224c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096811 May 12 14:49:48.253307 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 88/181] 10.222.0.49 () {64 vars in 1317 bytes} [Thu May 12 14:49:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:49:48.260412 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-131c109e-f37b-4481-939b-b497f06a82e6 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] 10.222.0.49 "GET /compute/v2.1/servers/364ca957-8a0e-45d2-bae2-a850c6708e51" status: 200 len: 1319 microversion: 2.1 time: 0.407125 May 12 14:49:48.261962 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 94/182] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:49:47 2022] GET /compute/v2.1/servers/364ca957-8a0e-45d2-bae2-a850c6708e51 => generated 1319 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:49:48.266570 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-dbd23295-742d-4319-9612-e6a1f0ed7e6a tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:48.266570 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-dbd23295-742d-4319-9612-e6a1f0ed7e6a tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:49:48.272555 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-dbd23295-742d-4319-9612-e6a1f0ed7e6a tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:48.273255 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-dbd23295-742d-4319-9612-e6a1f0ed7e6a tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:48.274217 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-dbd23295-742d-4319-9612-e6a1f0ed7e6a tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:48.275392 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-dbd23295-742d-4319-9612-e6a1f0ed7e6a tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:48.642717 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [req-827b1035-32a0-4a6b-952a-fbd092ca5442 req-54af2336-9e13-4089-9659-f4bd44af2617 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "364ca957-8a0e-45d2-bae2-a850c6708e51", "name": "network-vif-plugged", "status": "completed", "tag": "38f74632-a3ba-4b81-ac52-5f899e88b5f7"}]} {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:49:48.644055 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:49:48.644055 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: warnings.warn(msg) May 12 14:49:48.653904 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [req-827b1035-32a0-4a6b-952a-fbd092ca5442 req-54af2336-9e13-4089-9659-f4bd44af2617 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:48.654402 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [req-827b1035-32a0-4a6b-952a-fbd092ca5442 req-54af2336-9e13-4089-9659-f4bd44af2617 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:48.671580 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.compute.server_external_events [req-827b1035-32a0-4a6b-952a-fbd092ca5442 req-54af2336-9e13-4089-9659-f4bd44af2617 service nova] Creating event network-vif-plugged:38f74632-a3ba-4b81-ac52-5f899e88b5f7 for instance 364ca957-8a0e-45d2-bae2-a850c6708e51 on hv-cinder-83118 May 12 14:49:48.676905 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [req-827b1035-32a0-4a6b-952a-fbd092ca5442 req-54af2336-9e13-4089-9659-f4bd44af2617 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042510 May 12 14:49:48.677734 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 95/183] 10.222.0.49 () {64 vars in 1317 bytes} [Thu May 12 14:49:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 14:49:48.836526 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-dbd23295-742d-4319-9612-e6a1f0ed7e6a tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:48.845231 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-dbd23295-742d-4319-9612-e6a1f0ed7e6a tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1" status: 200 len: 1521 microversion: 2.1 time: 0.590755 May 12 14:49:48.845809 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 89/184] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:49:48 2022] GET /compute/v2.1/servers/d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1 => generated 1521 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:49:49.170629 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-2461df11-935c-4174-b936-d2b01659816f tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:49.171804 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-2461df11-935c-4174-b936-d2b01659816f tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:49:49.184461 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-2461df11-935c-4174-b936-d2b01659816f tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:49.185169 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-2461df11-935c-4174-b936-d2b01659816f tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:49.186598 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-2461df11-935c-4174-b936-d2b01659816f tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:49.187209 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-2461df11-935c-4174-b936-d2b01659816f tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:49.277404 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-5d77669a-d7b7-42b7-8c9e-a41d97c892b3 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:49.278020 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-5d77669a-d7b7-42b7-8c9e-a41d97c892b3 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] [instance: 364ca957-8a0e-45d2-bae2-a850c6708e51] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:49:49.286955 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-5d77669a-d7b7-42b7-8c9e-a41d97c892b3 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:49.287404 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-5d77669a-d7b7-42b7-8c9e-a41d97c892b3 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:49.288179 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-5d77669a-d7b7-42b7-8c9e-a41d97c892b3 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:49.288607 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-5d77669a-d7b7-42b7-8c9e-a41d97c892b3 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:49.417532 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-2461df11-935c-4174-b936-d2b01659816f tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:49.429245 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-2461df11-935c-4174-b936-d2b01659816f tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:49.431661 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-2461df11-935c-4174-b936-d2b01659816f tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:49.433223 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-2461df11-935c-4174-b936-d2b01659816f tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9" status: 200 len: 1407 microversion: 2.20 time: 0.266765 May 12 14:49:49.434883 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 96/185] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:49:49 2022] GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9 => generated 1407 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:49:49.606566 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-5d77669a-d7b7-42b7-8c9e-a41d97c892b3 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab371128e42444f49bc63661feaf7cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ed089c81294b4981046ede5ed951bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:49.640265 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-5d77669a-d7b7-42b7-8c9e-a41d97c892b3 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] 10.222.0.49 "GET /compute/v2.1/servers/364ca957-8a0e-45d2-bae2-a850c6708e51" status: 200 len: 1319 microversion: 2.1 time: 0.366680 May 12 14:49:49.642644 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 90/186] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:49:49 2022] GET /compute/v2.1/servers/364ca957-8a0e-45d2-bae2-a850c6708e51 => generated 1319 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:49:49.863016 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-e165379a-80b5-4868-939c-226184cc7f7b tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:49.863761 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-e165379a-80b5-4868-939c-226184cc7f7b tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:49:49.872689 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e165379a-80b5-4868-939c-226184cc7f7b tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:49.873367 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e165379a-80b5-4868-939c-226184cc7f7b tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:49.874305 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e165379a-80b5-4868-939c-226184cc7f7b tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:49.875008 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e165379a-80b5-4868-939c-226184cc7f7b tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:50.113347 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-e165379a-80b5-4868-939c-226184cc7f7b tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:50.122860 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-e165379a-80b5-4868-939c-226184cc7f7b tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1" status: 200 len: 1521 microversion: 2.1 time: 0.263844 May 12 14:49:50.123552 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 97/187] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:49:49 2022] GET /compute/v2.1/servers/d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1 => generated 1521 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:49:50.452916 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-0b017d0d-730a-4fcb-a400-b15810d53e5b tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:50.453775 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-0b017d0d-730a-4fcb-a400-b15810d53e5b tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:49:50.462872 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-0b017d0d-730a-4fcb-a400-b15810d53e5b tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:50.463518 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-0b017d0d-730a-4fcb-a400-b15810d53e5b tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:50.464559 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-0b017d0d-730a-4fcb-a400-b15810d53e5b tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:50.465075 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-0b017d0d-730a-4fcb-a400-b15810d53e5b tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:50.659111 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-d5981577-c552-473a-9649-baac01ebd171 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:50.659838 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-d5981577-c552-473a-9649-baac01ebd171 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] [instance: 364ca957-8a0e-45d2-bae2-a850c6708e51] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:49:50.667243 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-d5981577-c552-473a-9649-baac01ebd171 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:50.667794 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-d5981577-c552-473a-9649-baac01ebd171 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:50.668628 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-d5981577-c552-473a-9649-baac01ebd171 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:50.669088 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-d5981577-c552-473a-9649-baac01ebd171 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:50.826756 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-0b017d0d-730a-4fcb-a400-b15810d53e5b tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:50.836692 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-0b017d0d-730a-4fcb-a400-b15810d53e5b tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:50.838515 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-0b017d0d-730a-4fcb-a400-b15810d53e5b tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:50.839869 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-0b017d0d-730a-4fcb-a400-b15810d53e5b tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9" status: 200 len: 1407 microversion: 2.20 time: 0.391359 May 12 14:49:50.851064 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 91/188] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:49:50 2022] GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9 => generated 1407 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:49:50.927943 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-d5981577-c552-473a-9649-baac01ebd171 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab371128e42444f49bc63661feaf7cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ed089c81294b4981046ede5ed951bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:50.943198 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-d5981577-c552-473a-9649-baac01ebd171 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] 10.222.0.49 "GET /compute/v2.1/servers/364ca957-8a0e-45d2-bae2-a850c6708e51" status: 200 len: 1319 microversion: 2.1 time: 0.282849 May 12 14:49:50.943198 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 98/189] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:49:50 2022] GET /compute/v2.1/servers/364ca957-8a0e-45d2-bae2-a850c6708e51 => generated 1319 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:49:51.142018 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-b6e63194-9d0b-4677-b39f-d9a275cfd8c7 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:51.142636 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-b6e63194-9d0b-4677-b39f-d9a275cfd8c7 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:49:51.158904 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-b6e63194-9d0b-4677-b39f-d9a275cfd8c7 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:51.159755 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-b6e63194-9d0b-4677-b39f-d9a275cfd8c7 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:51.160911 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-b6e63194-9d0b-4677-b39f-d9a275cfd8c7 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:51.161764 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-b6e63194-9d0b-4677-b39f-d9a275cfd8c7 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:51.376104 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-b6e63194-9d0b-4677-b39f-d9a275cfd8c7 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:51.384968 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-b6e63194-9d0b-4677-b39f-d9a275cfd8c7 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1" status: 200 len: 1521 microversion: 2.1 time: 0.246591 May 12 14:49:51.385546 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 92/190] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:49:51 2022] GET /compute/v2.1/servers/d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1 => generated 1521 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:49:51.858510 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-40508d70-83ad-4b07-919c-53ecfa1326ca tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:51.859148 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-40508d70-83ad-4b07-919c-53ecfa1326ca tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:49:51.866328 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-40508d70-83ad-4b07-919c-53ecfa1326ca tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:51.866780 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-40508d70-83ad-4b07-919c-53ecfa1326ca tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:51.867582 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-40508d70-83ad-4b07-919c-53ecfa1326ca tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:51.868021 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-40508d70-83ad-4b07-919c-53ecfa1326ca tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:51.953037 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-0aae4994-56ae-442e-9b54-4ad05c87c216 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:51.953693 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-0aae4994-56ae-442e-9b54-4ad05c87c216 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] [instance: 364ca957-8a0e-45d2-bae2-a850c6708e51] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:49:51.961007 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-0aae4994-56ae-442e-9b54-4ad05c87c216 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:51.961460 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-0aae4994-56ae-442e-9b54-4ad05c87c216 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:51.962328 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-0aae4994-56ae-442e-9b54-4ad05c87c216 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:51.962765 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-0aae4994-56ae-442e-9b54-4ad05c87c216 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:52.197620 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-0aae4994-56ae-442e-9b54-4ad05c87c216 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab371128e42444f49bc63661feaf7cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ed089c81294b4981046ede5ed951bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:52.207822 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-40508d70-83ad-4b07-919c-53ecfa1326ca tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:52.209379 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-0aae4994-56ae-442e-9b54-4ad05c87c216 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] 10.222.0.49 "GET /compute/v2.1/servers/364ca957-8a0e-45d2-bae2-a850c6708e51" status: 200 len: 1507 microversion: 2.1 time: 0.260009 May 12 14:49:52.210111 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 93/191] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:49:51 2022] GET /compute/v2.1/servers/364ca957-8a0e-45d2-bae2-a850c6708e51 => generated 1507 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:49:52.218204 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-40508d70-83ad-4b07-919c-53ecfa1326ca tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:52.220042 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-40508d70-83ad-4b07-919c-53ecfa1326ca tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:52.224793 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-6238a277-7908-4ae6-b881-61b315423996 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-542164589", "imageRef": "a4587ab2-5f51-46a3-a023-0e6778ccaaa1", "flavorRef": "452", "networks": [{"uuid": "29318bea-5e26-4915-918a-926b02b62ecd"}]}} {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:49:52.239653 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-40508d70-83ad-4b07-919c-53ecfa1326ca tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9" status: 200 len: 1407 microversion: 2.20 time: 0.374690 May 12 14:49:52.239653 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 99/192] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:49:51 2022] GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9 => generated 1407 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:49:52.364336 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.network.neutron [None req-6238a277-7908-4ae6-b881-61b315423996 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] validate_networks() for [('29318bea-5e26-4915-918a-926b02b62ecd', None, None, None)] {{(pid=102212) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} May 12 14:49:52.403716 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-9d1f5cf6-43db-4121-adeb-49a70f4c4940 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:52.404446 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-9d1f5cf6-43db-4121-adeb-49a70f4c4940 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:49:52.423713 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-9d1f5cf6-43db-4121-adeb-49a70f4c4940 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:52.424988 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-9d1f5cf6-43db-4121-adeb-49a70f4c4940 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:52.426030 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-9d1f5cf6-43db-4121-adeb-49a70f4c4940 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:52.436852 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-9d1f5cf6-43db-4121-adeb-49a70f4c4940 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:52.747340 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-9d1f5cf6-43db-4121-adeb-49a70f4c4940 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:52.755925 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-9d1f5cf6-43db-4121-adeb-49a70f4c4940 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1" status: 200 len: 1521 microversion: 2.1 time: 0.357229 May 12 14:49:52.756502 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 100/193] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:49:52 2022] GET /compute/v2.1/servers/d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1 => generated 1521 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:49:53.168398 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.virt.hardware [None req-6238a277-7908-4ae6-b881-61b315423996 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Flavor limits 0:0:0 {{(pid=102212) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 14:49:53.169517 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.virt.hardware [None req-6238a277-7908-4ae6-b881-61b315423996 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Image limits 0:0:0 {{(pid=102212) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 14:49:53.170872 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.virt.hardware [None req-6238a277-7908-4ae6-b881-61b315423996 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Flavor pref 0:0:0 {{(pid=102212) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 14:49:53.171541 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.virt.hardware [None req-6238a277-7908-4ae6-b881-61b315423996 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Image pref 0:0:0 {{(pid=102212) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 14:49:53.172142 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.virt.hardware [None req-6238a277-7908-4ae6-b881-61b315423996 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=102212) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 14:49:53.184337 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-6238a277-7908-4ae6-b881-61b315423996 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:53.185482 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-6238a277-7908-4ae6-b881-61b315423996 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:53.186727 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-6238a277-7908-4ae6-b881-61b315423996 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:53.187459 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-6238a277-7908-4ae6-b881-61b315423996 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:53.225259 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.quota [None req-6238a277-7908-4ae6-b881-61b315423996 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Getting quotas for project 2c93480a75ab462f9181629c60772257. Resources: {'cores', 'ram', 'instances'} {{(pid=102212) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 12 14:49:53.231738 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.quota [None req-6238a277-7908-4ae6-b881-61b315423996 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Getting quotas for user a6e423a2656146a7a820f6be3af8d21c and project 2c93480a75ab462f9181629c60772257. Resources: {'cores', 'ram', 'instances'} {{(pid=102212) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 12 14:49:53.246058 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-6238a277-7908-4ae6-b881-61b315423996 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Going to run 1 instances... {{(pid=102212) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 12 14:49:53.249459 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-6238a277-7908-4ae6-b881-61b315423996 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] [instance: 1f762070-fb47-4d30-9d90-30b0db2dffd4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a4587ab2-5f51-46a3-a023-0e6778ccaaa1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=102212) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} May 12 14:49:53.249887 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-030b4b52-9443-41ed-91da-5bdf8140ef7c tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:53.250593 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-030b4b52-9443-41ed-91da-5bdf8140ef7c tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:49:53.268236 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-030b4b52-9443-41ed-91da-5bdf8140ef7c tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:53.272436 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-030b4b52-9443-41ed-91da-5bdf8140ef7c tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:53.273602 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-030b4b52-9443-41ed-91da-5bdf8140ef7c tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:53.274067 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-030b4b52-9443-41ed-91da-5bdf8140ef7c tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:53.405599 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-6238a277-7908-4ae6-b881-61b315423996 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.190952 May 12 14:49:53.412338 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 94/194] 10.222.0.49 () {60 vars in 1146 bytes} [Thu May 12 14:49:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1197 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 14:49:53.421542 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-aab3ac88-8edc-45a1-8dc5-21ebc8ad89e9 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:53.421542 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-aab3ac88-8edc-45a1-8dc5-21ebc8ad89e9 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] [instance: 1f762070-fb47-4d30-9d90-30b0db2dffd4] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:49:53.555036 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-aab3ac88-8edc-45a1-8dc5-21ebc8ad89e9 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e423a2656146a7a820f6be3af8d21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c93480a75ab462f9181629c60772257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:53.565160 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-aab3ac88-8edc-45a1-8dc5-21ebc8ad89e9 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] 10.222.0.49 "GET /compute/v2.1/servers/1f762070-fb47-4d30-9d90-30b0db2dffd4" status: 200 len: 1213 microversion: 2.1 time: 0.150694 May 12 14:49:53.566138 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 95/195] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:49:53 2022] GET /compute/v2.1/servers/1f762070-fb47-4d30-9d90-30b0db2dffd4 => generated 1213 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:49:53.579652 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-030b4b52-9443-41ed-91da-5bdf8140ef7c tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:53.580639 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-030b4b52-9443-41ed-91da-5bdf8140ef7c tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:53.581897 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-030b4b52-9443-41ed-91da-5bdf8140ef7c tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:53.583394 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-030b4b52-9443-41ed-91da-5bdf8140ef7c tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9" status: 200 len: 1407 microversion: 2.20 time: 0.340123 May 12 14:49:53.584601 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 101/196] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:49:53 2022] GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9 => generated 1407 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:49:53.773841 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-10243465-b4c1-42f1-9c67-75a9afca33a0 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:53.774993 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-10243465-b4c1-42f1-9c67-75a9afca33a0 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:49:53.783151 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-10243465-b4c1-42f1-9c67-75a9afca33a0 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:53.783613 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-10243465-b4c1-42f1-9c67-75a9afca33a0 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:53.784468 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-10243465-b4c1-42f1-9c67-75a9afca33a0 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:53.784916 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-10243465-b4c1-42f1-9c67-75a9afca33a0 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:54.047636 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-10243465-b4c1-42f1-9c67-75a9afca33a0 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:54.056257 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-10243465-b4c1-42f1-9c67-75a9afca33a0 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1" status: 200 len: 1521 microversion: 2.1 time: 0.286512 May 12 14:49:54.057315 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 96/197] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:49:53 2022] GET /compute/v2.1/servers/d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1 => generated 1521 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:49:54.582422 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-5e896c17-dbb2-4015-9f68-eacc8cbffaaa tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:54.585347 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-5e896c17-dbb2-4015-9f68-eacc8cbffaaa tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] [instance: 1f762070-fb47-4d30-9d90-30b0db2dffd4] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:49:54.601783 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-93c4a535-3cca-40b4-a516-e8bc0ac0cd5d tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:54.603414 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-93c4a535-3cca-40b4-a516-e8bc0ac0cd5d tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:49:54.613569 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-93c4a535-3cca-40b4-a516-e8bc0ac0cd5d tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:54.614526 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-93c4a535-3cca-40b4-a516-e8bc0ac0cd5d tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:54.615571 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-93c4a535-3cca-40b4-a516-e8bc0ac0cd5d tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:54.616015 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-93c4a535-3cca-40b4-a516-e8bc0ac0cd5d tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:54.661801 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-5e896c17-dbb2-4015-9f68-eacc8cbffaaa tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e423a2656146a7a820f6be3af8d21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c93480a75ab462f9181629c60772257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:54.669726 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-5e896c17-dbb2-4015-9f68-eacc8cbffaaa tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] 10.222.0.49 "GET /compute/v2.1/servers/1f762070-fb47-4d30-9d90-30b0db2dffd4" status: 200 len: 1213 microversion: 2.1 time: 0.091061 May 12 14:49:54.670466 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 102/198] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:49:54 2022] GET /compute/v2.1/servers/1f762070-fb47-4d30-9d90-30b0db2dffd4 => generated 1213 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:49:54.675262 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [req-f7585fd9-b8d6-4b70-a405-7b23677fd504 req-f8ef6548-4570-443d-8536-b13d5a9c3b41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9", "name": "network-vif-plugged", "status": "completed", "tag": "892fd785-17e4-4442-9f7d-2e5d18b22e9f"}]} {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:49:54.677090 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:49:54.677090 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: warnings.warn(msg) May 12 14:49:54.687355 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [req-f7585fd9-b8d6-4b70-a405-7b23677fd504 req-f8ef6548-4570-443d-8536-b13d5a9c3b41 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:54.687796 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [req-f7585fd9-b8d6-4b70-a405-7b23677fd504 req-f8ef6548-4570-443d-8536-b13d5a9c3b41 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:54.706950 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.compute.server_external_events [req-f7585fd9-b8d6-4b70-a405-7b23677fd504 req-f8ef6548-4570-443d-8536-b13d5a9c3b41 service nova] Creating event network-vif-plugged:892fd785-17e4-4442-9f7d-2e5d18b22e9f for instance a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9 on hv-cinder-83118 May 12 14:49:54.711864 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [req-f7585fd9-b8d6-4b70-a405-7b23677fd504 req-f8ef6548-4570-443d-8536-b13d5a9c3b41 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039988 May 12 14:49:54.712694 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 103/199] 10.222.0.49 () {64 vars in 1317 bytes} [Thu May 12 14:49:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:49:54.964572 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-93c4a535-3cca-40b4-a516-e8bc0ac0cd5d tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:54.983410 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-93c4a535-3cca-40b4-a516-e8bc0ac0cd5d tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:54.984980 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-93c4a535-3cca-40b4-a516-e8bc0ac0cd5d tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:54.986434 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-93c4a535-3cca-40b4-a516-e8bc0ac0cd5d tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9" status: 200 len: 1407 microversion: 2.20 time: 0.388852 May 12 14:49:54.987026 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 97/200] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:49:54 2022] GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9 => generated 1407 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 14:49:55.075331 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-65417a03-b62b-4219-b533-f246f113901e tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:55.076181 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-65417a03-b62b-4219-b533-f246f113901e tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:49:55.084796 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-65417a03-b62b-4219-b533-f246f113901e tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:55.085381 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-65417a03-b62b-4219-b533-f246f113901e tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:55.086248 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-65417a03-b62b-4219-b533-f246f113901e tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:55.086781 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-65417a03-b62b-4219-b533-f246f113901e tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:55.482774 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-65417a03-b62b-4219-b533-f246f113901e tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:55.494394 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-65417a03-b62b-4219-b533-f246f113901e tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1" status: 200 len: 1521 microversion: 2.1 time: 0.424124 May 12 14:49:55.495194 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 104/201] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:49:55 2022] GET /compute/v2.1/servers/d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1 => generated 1521 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:49:55.687923 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-509b0af8-6b3e-419f-90d7-2228178c030a tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:55.689373 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-509b0af8-6b3e-419f-90d7-2228178c030a tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] [instance: 1f762070-fb47-4d30-9d90-30b0db2dffd4] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:49:55.698329 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-509b0af8-6b3e-419f-90d7-2228178c030a tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:55.698794 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-509b0af8-6b3e-419f-90d7-2228178c030a tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:55.699653 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-509b0af8-6b3e-419f-90d7-2228178c030a tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:55.700150 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-509b0af8-6b3e-419f-90d7-2228178c030a tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:55.817949 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-509b0af8-6b3e-419f-90d7-2228178c030a tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e423a2656146a7a820f6be3af8d21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c93480a75ab462f9181629c60772257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:55.828583 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-509b0af8-6b3e-419f-90d7-2228178c030a tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] 10.222.0.49 "GET /compute/v2.1/servers/1f762070-fb47-4d30-9d90-30b0db2dffd4" status: 200 len: 1209 microversion: 2.1 time: 0.144130 May 12 14:49:55.829160 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 98/202] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:49:55 2022] GET /compute/v2.1/servers/1f762070-fb47-4d30-9d90-30b0db2dffd4 => generated 1209 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:49:56.005694 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-a3571b84-8dff-4bf4-b539-4ebee944948c tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:56.006887 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-a3571b84-8dff-4bf4-b539-4ebee944948c tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:49:56.014157 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-a3571b84-8dff-4bf4-b539-4ebee944948c tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:56.014880 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-a3571b84-8dff-4bf4-b539-4ebee944948c tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:56.015813 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-a3571b84-8dff-4bf4-b539-4ebee944948c tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:56.016255 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-a3571b84-8dff-4bf4-b539-4ebee944948c tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:56.255514 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-a3571b84-8dff-4bf4-b539-4ebee944948c tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:56.266236 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-a3571b84-8dff-4bf4-b539-4ebee944948c tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:56.268129 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-a3571b84-8dff-4bf4-b539-4ebee944948c tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:56.269377 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-a3571b84-8dff-4bf4-b539-4ebee944948c tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9" status: 200 len: 1407 microversion: 2.20 time: 0.268002 May 12 14:49:56.270017 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 105/203] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:49:56 2022] GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9 => generated 1407 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:49:56.511538 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-4dd9c3ad-d177-4230-a91f-aced1e6408f7 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:56.512059 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-4dd9c3ad-d177-4230-a91f-aced1e6408f7 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:49:56.519377 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-4dd9c3ad-d177-4230-a91f-aced1e6408f7 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:56.519826 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-4dd9c3ad-d177-4230-a91f-aced1e6408f7 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:56.520598 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-4dd9c3ad-d177-4230-a91f-aced1e6408f7 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:56.521292 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-4dd9c3ad-d177-4230-a91f-aced1e6408f7 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:56.760834 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-4dd9c3ad-d177-4230-a91f-aced1e6408f7 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:56.770280 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-4dd9c3ad-d177-4230-a91f-aced1e6408f7 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1" status: 200 len: 1521 microversion: 2.1 time: 0.262416 May 12 14:49:56.771284 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 99/204] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:49:56 2022] GET /compute/v2.1/servers/d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1 => generated 1521 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:49:56.847461 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-c9b008eb-0aa2-468b-8d79-9340c368c35d tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:56.848750 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-c9b008eb-0aa2-468b-8d79-9340c368c35d tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] [instance: 1f762070-fb47-4d30-9d90-30b0db2dffd4] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:49:56.859781 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-c9b008eb-0aa2-468b-8d79-9340c368c35d tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:56.860229 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-c9b008eb-0aa2-468b-8d79-9340c368c35d tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:56.861662 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-c9b008eb-0aa2-468b-8d79-9340c368c35d tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:56.862271 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-c9b008eb-0aa2-468b-8d79-9340c368c35d tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:57.116374 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-c9b008eb-0aa2-468b-8d79-9340c368c35d tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e423a2656146a7a820f6be3af8d21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c93480a75ab462f9181629c60772257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:57.126140 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-c9b008eb-0aa2-468b-8d79-9340c368c35d tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] 10.222.0.49 "GET /compute/v2.1/servers/1f762070-fb47-4d30-9d90-30b0db2dffd4" status: 200 len: 1265 microversion: 2.1 time: 0.284143 May 12 14:49:57.126889 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 106/205] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:49:56 2022] GET /compute/v2.1/servers/1f762070-fb47-4d30-9d90-30b0db2dffd4 => generated 1265 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:49:57.288166 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-90ed6101-5884-4cc7-a1c5-53f9cf6b0fc8 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:57.288864 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-90ed6101-5884-4cc7-a1c5-53f9cf6b0fc8 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:49:57.296939 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-90ed6101-5884-4cc7-a1c5-53f9cf6b0fc8 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:57.297731 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-90ed6101-5884-4cc7-a1c5-53f9cf6b0fc8 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:57.298713 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-90ed6101-5884-4cc7-a1c5-53f9cf6b0fc8 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:57.299376 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-90ed6101-5884-4cc7-a1c5-53f9cf6b0fc8 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:57.601031 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-e768a9f0-6e34-4a67-81c5-f657dbf5c70c tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:57.601955 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-e768a9f0-6e34-4a67-81c5-f657dbf5c70c tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:49:57.612626 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e768a9f0-6e34-4a67-81c5-f657dbf5c70c tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:57.613084 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e768a9f0-6e34-4a67-81c5-f657dbf5c70c tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:57.613929 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e768a9f0-6e34-4a67-81c5-f657dbf5c70c tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:57.614656 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e768a9f0-6e34-4a67-81c5-f657dbf5c70c tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:57.726794 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-e768a9f0-6e34-4a67-81c5-f657dbf5c70c tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7/ips" status: 200 len: 150 microversion: 2.1 time: 0.129052 May 12 14:49:57.732162 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 107/206] 10.222.0.49 () {58 vars in 1247 bytes} [Thu May 12 14:49:57 2022] GET /compute/v2.1/servers/64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7/ips => generated 150 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 14:49:57.754107 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-90ed6101-5884-4cc7-a1c5-53f9cf6b0fc8 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:57.764894 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-90ed6101-5884-4cc7-a1c5-53f9cf6b0fc8 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:57.767630 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-90ed6101-5884-4cc7-a1c5-53f9cf6b0fc8 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:57.768970 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-90ed6101-5884-4cc7-a1c5-53f9cf6b0fc8 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9" status: 200 len: 1598 microversion: 2.20 time: 0.484753 May 12 14:49:57.779867 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 100/207] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:49:57 2022] GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9 => generated 1598 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:49:57.794958 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-8733a8c2-e087-4b2e-9cc5-34b2c899817b tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:57.795897 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-8733a8c2-e087-4b2e-9cc5-34b2c899817b tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:49:57.800107 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-f71e1ece-89a0-4208-981d-e5c51375101f tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:57.800818 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-f71e1ece-89a0-4208-981d-e5c51375101f tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:49:57.804819 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-8733a8c2-e087-4b2e-9cc5-34b2c899817b tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:57.805501 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-8733a8c2-e087-4b2e-9cc5-34b2c899817b tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:57.807081 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-8733a8c2-e087-4b2e-9cc5-34b2c899817b tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:57.807740 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-8733a8c2-e087-4b2e-9cc5-34b2c899817b tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:57.815239 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-f71e1ece-89a0-4208-981d-e5c51375101f tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:57.815239 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-f71e1ece-89a0-4208-981d-e5c51375101f tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:57.825781 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-f71e1ece-89a0-4208-981d-e5c51375101f tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:57.827793 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-f71e1ece-89a0-4208-981d-e5c51375101f tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:58.169452 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-f71e1ece-89a0-4208-981d-e5c51375101f tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.375667 May 12 14:49:58.170382 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 101/208] 10.222.0.49 () {60 vars in 1315 bytes} [Thu May 12 14:49:57 2022] GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9/os-interface => generated 284 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 14:49:58.194627 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-db91c665-2750-4343-a603-baff2c2e57f1 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:58.201269 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-db91c665-2750-4343-a603-baff2c2e57f1 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] [instance: 1f762070-fb47-4d30-9d90-30b0db2dffd4] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:49:58.224547 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-db91c665-2750-4343-a603-baff2c2e57f1 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:58.224994 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-db91c665-2750-4343-a603-baff2c2e57f1 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:58.226295 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-db91c665-2750-4343-a603-baff2c2e57f1 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:58.226980 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-db91c665-2750-4343-a603-baff2c2e57f1 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:58.476829 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-8733a8c2-e087-4b2e-9cc5-34b2c899817b tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:58.491551 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-8733a8c2-e087-4b2e-9cc5-34b2c899817b tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1" status: 200 len: 1521 microversion: 2.1 time: 0.700127 May 12 14:49:58.492103 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 108/209] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:49:57 2022] GET /compute/v2.1/servers/d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1 => generated 1521 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:49:58.630694 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-db91c665-2750-4343-a603-baff2c2e57f1 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e423a2656146a7a820f6be3af8d21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c93480a75ab462f9181629c60772257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:49:58.653408 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-db91c665-2750-4343-a603-baff2c2e57f1 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] 10.222.0.49 "GET /compute/v2.1/servers/1f762070-fb47-4d30-9d90-30b0db2dffd4" status: 200 len: 1271 microversion: 2.1 time: 0.481698 May 12 14:49:58.654658 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 102/210] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:49:58 2022] GET /compute/v2.1/servers/1f762070-fb47-4d30-9d90-30b0db2dffd4 => generated 1271 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:49:59.510326 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-e6084b80-6a63-4685-92d9-1b5a8214440d tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:59.512440 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-e6084b80-6a63-4685-92d9-1b5a8214440d tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:49:59.535228 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e6084b80-6a63-4685-92d9-1b5a8214440d tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:59.535948 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e6084b80-6a63-4685-92d9-1b5a8214440d tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:59.536735 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e6084b80-6a63-4685-92d9-1b5a8214440d tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:59.537201 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e6084b80-6a63-4685-92d9-1b5a8214440d tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:59.673963 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-7b2b1fd8-f61b-4f18-a581-c00c408a880d tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:49:59.674601 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-7b2b1fd8-f61b-4f18-a581-c00c408a880d tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] [instance: 1f762070-fb47-4d30-9d90-30b0db2dffd4] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:49:59.685399 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-7b2b1fd8-f61b-4f18-a581-c00c408a880d tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:59.686067 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-7b2b1fd8-f61b-4f18-a581-c00c408a880d tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:49:59.687041 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-7b2b1fd8-f61b-4f18-a581-c00c408a880d tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:49:59.687630 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-7b2b1fd8-f61b-4f18-a581-c00c408a880d tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:00.071085 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-e6084b80-6a63-4685-92d9-1b5a8214440d tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:00.080129 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-e6084b80-6a63-4685-92d9-1b5a8214440d tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1" status: 200 len: 1521 microversion: 2.1 time: 0.574172 May 12 14:50:00.084585 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 109/211] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:49:59 2022] GET /compute/v2.1/servers/d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1 => generated 1521 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:50:00.089635 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-28731d01-e639-49f3-a231-ebb634f2de72 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "94003eba-9177-41ee-9b62-f08509f8da8d"}} {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:50:00.094023 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-28731d01-e639-49f3-a231-ebb634f2de72 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:00.113817 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-28731d01-e639-49f3-a231-ebb634f2de72 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:00.114377 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-28731d01-e639-49f3-a231-ebb634f2de72 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:00.116830 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-28731d01-e639-49f3-a231-ebb634f2de72 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:00.117489 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-28731d01-e639-49f3-a231-ebb634f2de72 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:00.810093 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-7b2b1fd8-f61b-4f18-a581-c00c408a880d tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e423a2656146a7a820f6be3af8d21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c93480a75ab462f9181629c60772257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:00.828262 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-7b2b1fd8-f61b-4f18-a581-c00c408a880d tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] 10.222.0.49 "GET /compute/v2.1/servers/1f762070-fb47-4d30-9d90-30b0db2dffd4" status: 200 len: 1313 microversion: 2.1 time: 1.160477 May 12 14:50:00.837881 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 103/212] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:49:59 2022] GET /compute/v2.1/servers/1f762070-fb47-4d30-9d90-30b0db2dffd4 => generated 1313 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:50:00.843138 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-ddbbd44c-64bc-4ba8-9911-ef5daa1fbc18 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:00.844447 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-ddbbd44c-64bc-4ba8-9911-ef5daa1fbc18 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 3062e66d-4c2a-4212-b186-ecafec6bde2e] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:00.852088 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-ddbbd44c-64bc-4ba8-9911-ef5daa1fbc18 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:00.853289 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-ddbbd44c-64bc-4ba8-9911-ef5daa1fbc18 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:00.854075 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-ddbbd44c-64bc-4ba8-9911-ef5daa1fbc18 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:00.854515 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-ddbbd44c-64bc-4ba8-9911-ef5daa1fbc18 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:00.918090 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-ddbbd44c-64bc-4ba8-9911-ef5daa1fbc18 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e/ips" status: 200 len: 146 microversion: 2.1 time: 0.078643 May 12 14:50:00.924385 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 104/213] 10.222.0.49 () {58 vars in 1247 bytes} [Thu May 12 14:50:00 2022] GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e/ips => generated 146 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:50:01.104493 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-f6e598c2-2724-4cbf-af3b-40ed44feec46 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:01.105547 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-f6e598c2-2724-4cbf-af3b-40ed44feec46 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:01.117007 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-f6e598c2-2724-4cbf-af3b-40ed44feec46 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:01.119521 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-f6e598c2-2724-4cbf-af3b-40ed44feec46 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:01.120930 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-f6e598c2-2724-4cbf-af3b-40ed44feec46 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:01.121595 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-f6e598c2-2724-4cbf-af3b-40ed44feec46 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:01.346220 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-28731d01-e639-49f3-a231-ebb634f2de72 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "POST /compute/v2.1/servers/64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.259932 May 12 14:50:01.346861 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 110/214] 10.222.0.49 () {60 vars in 1322 bytes} [Thu May 12 14:50:00 2022] POST /compute/v2.1/servers/64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7/os-volume_attachments => generated 194 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:50:01.846040 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-f6e9c337-3085-4720-a064-36a62a06a71e tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:01.846741 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-f6e9c337-3085-4720-a064-36a62a06a71e tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] [instance: 1f762070-fb47-4d30-9d90-30b0db2dffd4] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:01.863581 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-f6e598c2-2724-4cbf-af3b-40ed44feec46 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:01.879025 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-f6e9c337-3085-4720-a064-36a62a06a71e tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:01.880085 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-f6e9c337-3085-4720-a064-36a62a06a71e tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:01.881076 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-f6e9c337-3085-4720-a064-36a62a06a71e tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:01.881666 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-f6e9c337-3085-4720-a064-36a62a06a71e tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:01.893899 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-f6e598c2-2724-4cbf-af3b-40ed44feec46 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1" status: 200 len: 1521 microversion: 2.1 time: 0.796056 May 12 14:50:01.908277 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 105/215] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:01 2022] GET /compute/v2.1/servers/d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1 => generated 1521 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:50:02.836133 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [req-9320d9f2-3217-484d-a660-ef9a411f07b4 req-faba428a-23b5-40d1-8f05-0b1d0a69c774 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9", "tag": "892fd785-17e4-4442-9f7d-2e5d18b22e9f"}]} {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:50:02.838405 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:50:02.838405 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: warnings.warn(msg) May 12 14:50:02.847525 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [req-9320d9f2-3217-484d-a660-ef9a411f07b4 req-faba428a-23b5-40d1-8f05-0b1d0a69c774 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:02.848174 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [req-9320d9f2-3217-484d-a660-ef9a411f07b4 req-faba428a-23b5-40d1-8f05-0b1d0a69c774 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:02.865378 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-f6e9c337-3085-4720-a064-36a62a06a71e tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e423a2656146a7a820f6be3af8d21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c93480a75ab462f9181629c60772257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:02.878043 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.compute.server_external_events [req-9320d9f2-3217-484d-a660-ef9a411f07b4 req-faba428a-23b5-40d1-8f05-0b1d0a69c774 service nova] Creating event network-changed:892fd785-17e4-4442-9f7d-2e5d18b22e9f for instance a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9 on hv-cinder-83118 May 12 14:50:02.881537 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-f6e9c337-3085-4720-a064-36a62a06a71e tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] 10.222.0.49 "GET /compute/v2.1/servers/1f762070-fb47-4d30-9d90-30b0db2dffd4" status: 200 len: 1313 microversion: 2.1 time: 1.039876 May 12 14:50:02.884575 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [req-9320d9f2-3217-484d-a660-ef9a411f07b4 req-faba428a-23b5-40d1-8f05-0b1d0a69c774 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053499 May 12 14:50:02.885233 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 111/216] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:01 2022] GET /compute/v2.1/servers/1f762070-fb47-4d30-9d90-30b0db2dffd4 => generated 1313 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:50:02.889192 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 106/217] 10.222.0.49 () {64 vars in 1317 bytes} [Thu May 12 14:50:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:50:02.915489 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-c36c8c18-0766-4a65-8374-e75b36ab483b tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:02.920965 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-c36c8c18-0766-4a65-8374-e75b36ab483b tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:02.924499 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-c36c8c18-0766-4a65-8374-e75b36ab483b tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:02.924969 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-c36c8c18-0766-4a65-8374-e75b36ab483b tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:02.925768 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-c36c8c18-0766-4a65-8374-e75b36ab483b tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:02.926211 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-c36c8c18-0766-4a65-8374-e75b36ab483b tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:03.906338 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-db82b6bf-3773-4a05-8725-a62796da6212 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:03.908533 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-db82b6bf-3773-4a05-8725-a62796da6212 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] [instance: 1f762070-fb47-4d30-9d90-30b0db2dffd4] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:03.926158 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-db82b6bf-3773-4a05-8725-a62796da6212 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:03.932447 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-db82b6bf-3773-4a05-8725-a62796da6212 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:03.939306 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-db82b6bf-3773-4a05-8725-a62796da6212 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:03.939306 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-db82b6bf-3773-4a05-8725-a62796da6212 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:03.982562 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-c36c8c18-0766-4a65-8374-e75b36ab483b tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:03.995347 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-c36c8c18-0766-4a65-8374-e75b36ab483b tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1" status: 200 len: 1521 microversion: 2.1 time: 1.080649 May 12 14:50:03.996460 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 112/218] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:02 2022] GET /compute/v2.1/servers/d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1 => generated 1521 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:50:04.976825 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-2b76a0a2-0d10-44b7-bba7-abce8f0b4699 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c56f716e-f085-4f7a-8744-036b04bffcdf"}} {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:50:04.978674 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-2b76a0a2-0d10-44b7-bba7-abce8f0b4699 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 3062e66d-4c2a-4212-b186-ecafec6bde2e] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:04.987164 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-2b76a0a2-0d10-44b7-bba7-abce8f0b4699 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:04.988279 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-2b76a0a2-0d10-44b7-bba7-abce8f0b4699 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:04.989406 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-2b76a0a2-0d10-44b7-bba7-abce8f0b4699 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:04.990033 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-2b76a0a2-0d10-44b7-bba7-abce8f0b4699 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:05.050006 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-db82b6bf-3773-4a05-8725-a62796da6212 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e423a2656146a7a820f6be3af8d21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c93480a75ab462f9181629c60772257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:05.064847 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-db82b6bf-3773-4a05-8725-a62796da6212 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] 10.222.0.49 "GET /compute/v2.1/servers/1f762070-fb47-4d30-9d90-30b0db2dffd4" status: 200 len: 1313 microversion: 2.1 time: 1.167643 May 12 14:50:05.076094 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 107/219] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:03 2022] GET /compute/v2.1/servers/1f762070-fb47-4d30-9d90-30b0db2dffd4 => generated 1313 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:50:05.081486 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [req-49fd32e8-0568-42f2-ab25-e0f7650cff56 req-45b159ac-a7d7-4f99-9ef4-33ae3819e57c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f762070-fb47-4d30-9d90-30b0db2dffd4", "tag": "8d88c3a6-67ec-4ff0-9f45-2f453178c148"}]} {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:50:05.083052 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:50:05.083052 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: warnings.warn(msg) May 12 14:50:05.096582 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [req-49fd32e8-0568-42f2-ab25-e0f7650cff56 req-45b159ac-a7d7-4f99-9ef4-33ae3819e57c service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:05.097271 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [req-49fd32e8-0568-42f2-ab25-e0f7650cff56 req-45b159ac-a7d7-4f99-9ef4-33ae3819e57c service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:05.127274 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.compute.server_external_events [req-49fd32e8-0568-42f2-ab25-e0f7650cff56 req-45b159ac-a7d7-4f99-9ef4-33ae3819e57c service nova] Creating event network-changed:8d88c3a6-67ec-4ff0-9f45-2f453178c148 for instance 1f762070-fb47-4d30-9d90-30b0db2dffd4 on hv-cinder-83118 May 12 14:50:05.132765 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [req-49fd32e8-0568-42f2-ab25-e0f7650cff56 req-45b159ac-a7d7-4f99-9ef4-33ae3819e57c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055056 May 12 14:50:05.134613 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 108/220] 10.222.0.49 () {64 vars in 1317 bytes} [Thu May 12 14:50:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:50:05.140382 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-48b90de3-e924-4625-8603-a2a9caa2510d tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:05.141085 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-48b90de3-e924-4625-8603-a2a9caa2510d tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:05.150253 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-48b90de3-e924-4625-8603-a2a9caa2510d tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:05.155005 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-48b90de3-e924-4625-8603-a2a9caa2510d tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:05.157044 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-48b90de3-e924-4625-8603-a2a9caa2510d tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:05.157655 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-48b90de3-e924-4625-8603-a2a9caa2510d tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:05.898790 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-48b90de3-e924-4625-8603-a2a9caa2510d tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:05.914180 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-48b90de3-e924-4625-8603-a2a9caa2510d tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1" status: 200 len: 1521 microversion: 2.1 time: 0.774570 May 12 14:50:05.915302 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 109/221] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:05 2022] GET /compute/v2.1/servers/d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1 => generated 1521 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:50:06.082303 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-d88dff04-7786-4a88-b812-8e3c7309b71f tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:06.084085 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-d88dff04-7786-4a88-b812-8e3c7309b71f tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] [instance: 1f762070-fb47-4d30-9d90-30b0db2dffd4] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:06.111034 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-d88dff04-7786-4a88-b812-8e3c7309b71f tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:06.111821 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-d88dff04-7786-4a88-b812-8e3c7309b71f tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:06.115151 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-d88dff04-7786-4a88-b812-8e3c7309b71f tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:06.115151 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-d88dff04-7786-4a88-b812-8e3c7309b71f tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:06.443846 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-2b76a0a2-0d10-44b7-bba7-abce8f0b4699 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "POST /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.472308 May 12 14:50:06.449660 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 113/222] 10.222.0.49 () {60 vars in 1322 bytes} [Thu May 12 14:50:04 2022] POST /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e/os-volume_attachments => generated 194 bytes in 1475 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 14:50:06.898008 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-d88dff04-7786-4a88-b812-8e3c7309b71f tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e423a2656146a7a820f6be3af8d21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c93480a75ab462f9181629c60772257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:06.909497 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-d88dff04-7786-4a88-b812-8e3c7309b71f tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] 10.222.0.49 "GET /compute/v2.1/servers/1f762070-fb47-4d30-9d90-30b0db2dffd4" status: 200 len: 1313 microversion: 2.1 time: 0.831778 May 12 14:50:06.911079 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 110/223] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:06 2022] GET /compute/v2.1/servers/1f762070-fb47-4d30-9d90-30b0db2dffd4 => generated 1313 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:50:06.933055 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-37d09580-69b7-45ee-ae53-2c7450b46a4e tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:06.934000 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-37d09580-69b7-45ee-ae53-2c7450b46a4e tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:06.943366 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-37d09580-69b7-45ee-ae53-2c7450b46a4e tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:06.944037 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-37d09580-69b7-45ee-ae53-2c7450b46a4e tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:06.945022 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-37d09580-69b7-45ee-ae53-2c7450b46a4e tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:06.945799 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-37d09580-69b7-45ee-ae53-2c7450b46a4e tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:07.307697 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-37d09580-69b7-45ee-ae53-2c7450b46a4e tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:07.317735 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-37d09580-69b7-45ee-ae53-2c7450b46a4e tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1" status: 200 len: 1521 microversion: 2.1 time: 0.389798 May 12 14:50:07.318573 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 114/224] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:06 2022] GET /compute/v2.1/servers/d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1 => generated 1521 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:50:07.931587 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-9a802cb4-6a02-4967-b573-77179b7acd1c tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:07.932307 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-9a802cb4-6a02-4967-b573-77179b7acd1c tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] [instance: 1f762070-fb47-4d30-9d90-30b0db2dffd4] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:07.940291 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-9a802cb4-6a02-4967-b573-77179b7acd1c tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:07.940737 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-9a802cb4-6a02-4967-b573-77179b7acd1c tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:07.941519 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-9a802cb4-6a02-4967-b573-77179b7acd1c tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:07.941957 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-9a802cb4-6a02-4967-b573-77179b7acd1c tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:08.190540 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-9a802cb4-6a02-4967-b573-77179b7acd1c tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e423a2656146a7a820f6be3af8d21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c93480a75ab462f9181629c60772257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:08.199318 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-9a802cb4-6a02-4967-b573-77179b7acd1c tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] 10.222.0.49 "GET /compute/v2.1/servers/1f762070-fb47-4d30-9d90-30b0db2dffd4" status: 200 len: 1313 microversion: 2.1 time: 0.271831 May 12 14:50:08.199898 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 111/225] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:07 2022] GET /compute/v2.1/servers/1f762070-fb47-4d30-9d90-30b0db2dffd4 => generated 1313 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:50:08.335460 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-0a6a0a0d-0f8c-4ba3-b04d-d90367fa05ba tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:08.336147 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-0a6a0a0d-0f8c-4ba3-b04d-d90367fa05ba tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:08.346394 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-0a6a0a0d-0f8c-4ba3-b04d-d90367fa05ba tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:08.347279 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-0a6a0a0d-0f8c-4ba3-b04d-d90367fa05ba tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:08.348356 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-0a6a0a0d-0f8c-4ba3-b04d-d90367fa05ba tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:08.349023 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-0a6a0a0d-0f8c-4ba3-b04d-d90367fa05ba tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:08.951777 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-0a6a0a0d-0f8c-4ba3-b04d-d90367fa05ba tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:08.964558 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-0a6a0a0d-0f8c-4ba3-b04d-d90367fa05ba tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1" status: 200 len: 1521 microversion: 2.1 time: 0.632727 May 12 14:50:08.965302 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 115/226] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:08 2022] GET /compute/v2.1/servers/d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1 => generated 1521 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:50:09.221961 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-67efe5dc-3e64-4d23-90ba-3d23e022d6a9 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:09.223265 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-67efe5dc-3e64-4d23-90ba-3d23e022d6a9 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] [instance: 1f762070-fb47-4d30-9d90-30b0db2dffd4] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:09.236122 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-67efe5dc-3e64-4d23-90ba-3d23e022d6a9 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:09.236984 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-67efe5dc-3e64-4d23-90ba-3d23e022d6a9 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:09.238336 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-67efe5dc-3e64-4d23-90ba-3d23e022d6a9 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:09.239092 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-67efe5dc-3e64-4d23-90ba-3d23e022d6a9 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:09.510353 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-67efe5dc-3e64-4d23-90ba-3d23e022d6a9 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e423a2656146a7a820f6be3af8d21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c93480a75ab462f9181629c60772257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:09.519304 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-67efe5dc-3e64-4d23-90ba-3d23e022d6a9 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] 10.222.0.49 "GET /compute/v2.1/servers/1f762070-fb47-4d30-9d90-30b0db2dffd4" status: 200 len: 1313 microversion: 2.1 time: 0.306419 May 12 14:50:09.520193 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 112/227] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:09 2022] GET /compute/v2.1/servers/1f762070-fb47-4d30-9d90-30b0db2dffd4 => generated 1313 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:50:09.984457 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-050b2d5e-6790-4d56-974f-8af02f001164 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:09.986041 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-050b2d5e-6790-4d56-974f-8af02f001164 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:09.996919 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-050b2d5e-6790-4d56-974f-8af02f001164 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:09.997805 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-050b2d5e-6790-4d56-974f-8af02f001164 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:09.999159 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-050b2d5e-6790-4d56-974f-8af02f001164 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:09.999757 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-050b2d5e-6790-4d56-974f-8af02f001164 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:10.451513 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-050b2d5e-6790-4d56-974f-8af02f001164 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:10.462122 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-050b2d5e-6790-4d56-974f-8af02f001164 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1" status: 200 len: 1521 microversion: 2.1 time: 0.482432 May 12 14:50:10.462910 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 116/228] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:09 2022] GET /compute/v2.1/servers/d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1 => generated 1521 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:50:10.536215 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-58a27b8c-8f0c-4db6-b3dc-379b5eaf1e80 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:10.536826 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-58a27b8c-8f0c-4db6-b3dc-379b5eaf1e80 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] [instance: 1f762070-fb47-4d30-9d90-30b0db2dffd4] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:10.544885 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-58a27b8c-8f0c-4db6-b3dc-379b5eaf1e80 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:10.545338 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-58a27b8c-8f0c-4db6-b3dc-379b5eaf1e80 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:10.546125 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-58a27b8c-8f0c-4db6-b3dc-379b5eaf1e80 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:10.546561 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-58a27b8c-8f0c-4db6-b3dc-379b5eaf1e80 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:10.766586 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-58a27b8c-8f0c-4db6-b3dc-379b5eaf1e80 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e423a2656146a7a820f6be3af8d21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c93480a75ab462f9181629c60772257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:10.777648 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-58a27b8c-8f0c-4db6-b3dc-379b5eaf1e80 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] 10.222.0.49 "GET /compute/v2.1/servers/1f762070-fb47-4d30-9d90-30b0db2dffd4" status: 200 len: 1313 microversion: 2.1 time: 0.244765 May 12 14:50:10.779144 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 113/229] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:10 2022] GET /compute/v2.1/servers/1f762070-fb47-4d30-9d90-30b0db2dffd4 => generated 1313 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:50:11.140457 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-c83582d4-deb3-45f3-be44-e6a584679318 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Action: 'create', calling method: .version_select at 0x7ff77e9e5ee0>, body: {"keypair": {"name": "tempest-keypair-90070329", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNulj3qokWXFEvFVQ1iGNkzfyU1QYP/RIuoIGWJeOO6gWx3fv3LNUZhKXVXvxORx8ttw6jPVdi6mycuib4CWoIMa3NpjZ71m2dgtZf4zLQT5jj4isQ7kyupI+ZFOkSB/8w=="}} {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:50:11.163201 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.quota [None req-c83582d4-deb3-45f3-be44-e6a584679318 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Getting quotas for project 67a8451272cc41ebaf1598ed940bf09a. Resources: {'key_pairs'} {{(pid=102213) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 12 14:50:11.181607 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.quota [None req-c83582d4-deb3-45f3-be44-e6a584679318 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Getting quotas for user 6a641a08648b454780081ecc2e291066 and project 67a8451272cc41ebaf1598ed940bf09a. Resources: {'key_pairs'} {{(pid=102213) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 12 14:50:11.310358 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-c83582d4-deb3-45f3-be44-e6a584679318 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.173820 May 12 14:50:11.316213 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 117/230] 10.222.0.49 () {60 vars in 1158 bytes} [Thu May 12 14:50:11 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:50:11.482179 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-79140382-44a3-40fb-a553-2c3bcb3ebd77 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:11.482909 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-79140382-44a3-40fb-a553-2c3bcb3ebd77 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:11.491215 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-79140382-44a3-40fb-a553-2c3bcb3ebd77 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:11.491931 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-79140382-44a3-40fb-a553-2c3bcb3ebd77 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:11.493292 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-79140382-44a3-40fb-a553-2c3bcb3ebd77 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:11.493801 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-79140382-44a3-40fb-a553-2c3bcb3ebd77 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:11.762338 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-79140382-44a3-40fb-a553-2c3bcb3ebd77 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:11.772816 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-79140382-44a3-40fb-a553-2c3bcb3ebd77 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1" status: 200 len: 1521 microversion: 2.1 time: 0.297066 May 12 14:50:11.773399 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 114/231] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:11 2022] GET /compute/v2.1/servers/d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1 => generated 1521 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:50:11.795106 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-3b02215f-4ea7-465a-8e88-1455e6b9221e tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:11.795982 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-3b02215f-4ea7-465a-8e88-1455e6b9221e tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] [instance: 1f762070-fb47-4d30-9d90-30b0db2dffd4] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:11.809926 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-3b02215f-4ea7-465a-8e88-1455e6b9221e tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:11.810717 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-3b02215f-4ea7-465a-8e88-1455e6b9221e tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:11.811824 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-3b02215f-4ea7-465a-8e88-1455e6b9221e tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:11.812417 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-3b02215f-4ea7-465a-8e88-1455e6b9221e tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:12.513038 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-3b02215f-4ea7-465a-8e88-1455e6b9221e tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e423a2656146a7a820f6be3af8d21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c93480a75ab462f9181629c60772257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:12.522275 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-3b02215f-4ea7-465a-8e88-1455e6b9221e tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] 10.222.0.49 "GET /compute/v2.1/servers/1f762070-fb47-4d30-9d90-30b0db2dffd4" status: 200 len: 1313 microversion: 2.1 time: 0.731350 May 12 14:50:12.528848 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 118/232] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:11 2022] GET /compute/v2.1/servers/1f762070-fb47-4d30-9d90-30b0db2dffd4 => generated 1313 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:50:12.740731 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [req-a1c5df11-eb2e-4b2f-a480-1795fc55ee6c req-473728ab-4969-483f-a3c0-e6ce9286a2c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f762070-fb47-4d30-9d90-30b0db2dffd4", "name": "network-vif-plugged", "status": "completed", "tag": "8d88c3a6-67ec-4ff0-9f45-2f453178c148"}]} {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:50:12.742249 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:50:12.742249 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: warnings.warn(msg) May 12 14:50:12.753676 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [req-a1c5df11-eb2e-4b2f-a480-1795fc55ee6c req-473728ab-4969-483f-a3c0-e6ce9286a2c8 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:12.754130 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [req-a1c5df11-eb2e-4b2f-a480-1795fc55ee6c req-473728ab-4969-483f-a3c0-e6ce9286a2c8 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:12.771369 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.compute.server_external_events [req-a1c5df11-eb2e-4b2f-a480-1795fc55ee6c req-473728ab-4969-483f-a3c0-e6ce9286a2c8 service nova] Creating event network-vif-plugged:8d88c3a6-67ec-4ff0-9f45-2f453178c148 for instance 1f762070-fb47-4d30-9d90-30b0db2dffd4 on hv-cinder-83118 May 12 14:50:12.779242 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [req-a1c5df11-eb2e-4b2f-a480-1795fc55ee6c req-473728ab-4969-483f-a3c0-e6ce9286a2c8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039295 May 12 14:50:12.779888 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 115/233] 10.222.0.49 () {64 vars in 1317 bytes} [Thu May 12 14:50:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:50:12.789252 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-ed0a64be-4dd9-4f77-8fc0-7a1a4af6e48a tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:12.790647 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-ed0a64be-4dd9-4f77-8fc0-7a1a4af6e48a tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:12.807120 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-ed0a64be-4dd9-4f77-8fc0-7a1a4af6e48a tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:12.807809 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-ed0a64be-4dd9-4f77-8fc0-7a1a4af6e48a tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:12.808763 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-ed0a64be-4dd9-4f77-8fc0-7a1a4af6e48a tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:12.809380 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-ed0a64be-4dd9-4f77-8fc0-7a1a4af6e48a tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:13.451716 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-ed0a64be-4dd9-4f77-8fc0-7a1a4af6e48a tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:13.460598 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-ed0a64be-4dd9-4f77-8fc0-7a1a4af6e48a tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1" status: 200 len: 1521 microversion: 2.1 time: 0.674978 May 12 14:50:13.471443 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 119/234] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:12 2022] GET /compute/v2.1/servers/d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1 => generated 1521 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:50:13.547903 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-bbd410e0-10eb-4687-867a-7b08d0ea30b8 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:13.548891 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-bbd410e0-10eb-4687-867a-7b08d0ea30b8 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] [instance: 1f762070-fb47-4d30-9d90-30b0db2dffd4] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:13.559674 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-bbd410e0-10eb-4687-867a-7b08d0ea30b8 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:13.560360 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-bbd410e0-10eb-4687-867a-7b08d0ea30b8 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:13.565163 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-bbd410e0-10eb-4687-867a-7b08d0ea30b8 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:13.565163 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-bbd410e0-10eb-4687-867a-7b08d0ea30b8 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:14.034881 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-bbd410e0-10eb-4687-867a-7b08d0ea30b8 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e423a2656146a7a820f6be3af8d21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c93480a75ab462f9181629c60772257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:14.049371 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-bbd410e0-10eb-4687-867a-7b08d0ea30b8 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] 10.222.0.49 "GET /compute/v2.1/servers/1f762070-fb47-4d30-9d90-30b0db2dffd4" status: 200 len: 1313 microversion: 2.1 time: 0.507121 May 12 14:50:14.050730 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 116/235] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:13 2022] GET /compute/v2.1/servers/1f762070-fb47-4d30-9d90-30b0db2dffd4 => generated 1313 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:50:14.214833 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-0df24812-bf90-47ce-8932-80f2edc92c62 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eb4abdb4-41dd-4398-b68c-1fdee4b2fb5e", "device": "/dev/sdb"}} {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:50:14.217793 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-0df24812-bf90-47ce-8932-80f2edc92c62 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] [instance: 364ca957-8a0e-45d2-bae2-a850c6708e51] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:14.227911 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-0df24812-bf90-47ce-8932-80f2edc92c62 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:14.228769 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-0df24812-bf90-47ce-8932-80f2edc92c62 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:14.230474 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-0df24812-bf90-47ce-8932-80f2edc92c62 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:14.231101 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-0df24812-bf90-47ce-8932-80f2edc92c62 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:14.478460 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-20d61275-cb68-459b-8cec-e6f670912875 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:14.479108 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-20d61275-cb68-459b-8cec-e6f670912875 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:14.489185 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-20d61275-cb68-459b-8cec-e6f670912875 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:14.489559 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-20d61275-cb68-459b-8cec-e6f670912875 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:14.490327 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-20d61275-cb68-459b-8cec-e6f670912875 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:14.491500 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-20d61275-cb68-459b-8cec-e6f670912875 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:14.872675 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-20d61275-cb68-459b-8cec-e6f670912875 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:14.905222 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-20d61275-cb68-459b-8cec-e6f670912875 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1" status: 200 len: 1501 microversion: 2.1 time: 0.425036 May 12 14:50:14.917106 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 117/236] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:14 2022] GET /compute/v2.1/servers/d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1 => generated 1501 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:50:14.931835 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-43580eeb-0311-42d1-b1b1-8e98dd802b5c tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f6050104-dd33-4e85-a03b-835470fd628a"}} {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:50:14.932959 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-43580eeb-0311-42d1-b1b1-8e98dd802b5c tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:14.972207 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-43580eeb-0311-42d1-b1b1-8e98dd802b5c tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:14.972661 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-43580eeb-0311-42d1-b1b1-8e98dd802b5c tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:14.973499 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-43580eeb-0311-42d1-b1b1-8e98dd802b5c tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:14.973936 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-43580eeb-0311-42d1-b1b1-8e98dd802b5c tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:15.141706 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.wsgi [None req-43580eeb-0311-42d1-b1b1-8e98dd802b5c tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] HTTP exception thrown: Cannot 'attach_volume' instance d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1 while it is in vm_state rescued May 12 14:50:15.148180 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-43580eeb-0311-42d1-b1b1-8e98dd802b5c tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Returning 409 to user: Cannot 'attach_volume' instance d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1 while it is in vm_state rescued {{(pid=102212) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 12 14:50:15.152970 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-43580eeb-0311-42d1-b1b1-8e98dd802b5c tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "POST /compute/v2.1/servers/d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.222732 May 12 14:50:15.152970 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 118/237] 10.222.0.49 () {60 vars in 1322 bytes} [Thu May 12 14:50:14 2022] POST /compute/v2.1/servers/d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1/os-volume_attachments => generated 152 bytes in 224 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 12 14:50:15.156605 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-13825eff-a274-4746-9978-4ca844838da2 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:15.157399 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-13825eff-a274-4746-9978-4ca844838da2 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] [instance: 1f762070-fb47-4d30-9d90-30b0db2dffd4] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:15.165935 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-13825eff-a274-4746-9978-4ca844838da2 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:15.166801 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-13825eff-a274-4746-9978-4ca844838da2 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:15.172194 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-13825eff-a274-4746-9978-4ca844838da2 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:15.174097 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-13825eff-a274-4746-9978-4ca844838da2 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:15.375670 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-0df24812-bf90-47ce-8932-80f2edc92c62 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] 10.222.0.49 "POST /compute/v2.1/servers/364ca957-8a0e-45d2-bae2-a850c6708e51/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.165293 May 12 14:50:15.377648 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 120/238] 10.222.0.49 () {60 vars in 1322 bytes} [Thu May 12 14:50:14 2022] POST /compute/v2.1/servers/364ca957-8a0e-45d2-bae2-a850c6708e51/os-volume_attachments => generated 194 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:50:15.388348 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-518a665d-c019-4b11-b59e-822fac7429b9 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:50:15.388348 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-518a665d-c019-4b11-b59e-822fac7429b9 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:15.451684 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-518a665d-c019-4b11-b59e-822fac7429b9 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:15.456038 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-518a665d-c019-4b11-b59e-822fac7429b9 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:15.460799 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-518a665d-c019-4b11-b59e-822fac7429b9 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:15.461626 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-518a665d-c019-4b11-b59e-822fac7429b9 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:15.991814 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-13825eff-a274-4746-9978-4ca844838da2 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e423a2656146a7a820f6be3af8d21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c93480a75ab462f9181629c60772257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:16.005571 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-13825eff-a274-4746-9978-4ca844838da2 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] 10.222.0.49 "GET /compute/v2.1/servers/1f762070-fb47-4d30-9d90-30b0db2dffd4" status: 200 len: 1313 microversion: 2.1 time: 0.853449 May 12 14:50:16.008356 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 119/239] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:15 2022] GET /compute/v2.1/servers/1f762070-fb47-4d30-9d90-30b0db2dffd4 => generated 1313 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:50:16.010499 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-518a665d-c019-4b11-b59e-822fac7429b9 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "POST /compute/v2.1/servers/d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1/action" status: 202 len: 0 microversion: 2.1 time: 0.631003 May 12 14:50:16.014333 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 121/240] 10.222.0.49 () {60 vars in 1277 bytes} [Thu May 12 14:50:15 2022] POST /compute/v2.1/servers/d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1/action => generated 0 bytes in 633 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 14:50:16.022340 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-52bf4950-3f6f-4a07-bab2-ce2d460962ae tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:16.023392 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-52bf4950-3f6f-4a07-bab2-ce2d460962ae tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:16.041892 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-52bf4950-3f6f-4a07-bab2-ce2d460962ae tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:16.042440 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-52bf4950-3f6f-4a07-bab2-ce2d460962ae tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:16.043693 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-52bf4950-3f6f-4a07-bab2-ce2d460962ae tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:16.044332 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-52bf4950-3f6f-4a07-bab2-ce2d460962ae tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:16.335687 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-52bf4950-3f6f-4a07-bab2-ce2d460962ae tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:16.348154 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-52bf4950-3f6f-4a07-bab2-ce2d460962ae tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1" status: 200 len: 1509 microversion: 2.1 time: 0.331496 May 12 14:50:16.360137 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 122/241] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:16 2022] GET /compute/v2.1/servers/d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1 => generated 1509 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:50:16.420303 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-793a8ebe-d8d1-4020-97a7-506f2e8aaf04 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Action: 'create', calling method: .version_select at 0x7ff77fbdbdc0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1024472412", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAh1kQTfP3eeu3HPvXNT/rnbxu6c3SZnkABqLJqMj86MfaAazN09PrvBg9iSKFHZoeIKOEnuSWjVAIc5E+hiZ58An7kpwjezxZVFdJ1PiGe4rFtFy6SLmB7C8NtTvsrXKw=="}} {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:50:16.446893 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.quota [None req-793a8ebe-d8d1-4020-97a7-506f2e8aaf04 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Getting quotas for project 0bfe8d8bce3f496d9162c7f9c8727273. Resources: {'key_pairs'} {{(pid=102212) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 12 14:50:16.451048 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.quota [None req-793a8ebe-d8d1-4020-97a7-506f2e8aaf04 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Getting quotas for user be6d3863350647cdb3091c1006d56c64 and project 0bfe8d8bce3f496d9162c7f9c8727273. Resources: {'key_pairs'} {{(pid=102212) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 12 14:50:16.574167 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-793a8ebe-d8d1-4020-97a7-506f2e8aaf04 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.563163 May 12 14:50:16.576296 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 120/242] 10.222.0.49 () {60 vars in 1158 bytes} [Thu May 12 14:50:16 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:50:16.690490 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-c6958099-1a0d-46d9-9fe6-3c6792f04477 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1142425063", "imageRef": "a4587ab2-5f51-46a3-a023-0e6778ccaaa1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9862f13a-dccf-465d-abda-f29b2d232c04"}], "security_groups": [{"name": "tempest-securitygroup--1054684955"}], "key_name": "tempest-keypair-90070329", "user_data": "}} {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:50:16.844641 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.network.neutron [None req-c6958099-1a0d-46d9-9fe6-3c6792f04477 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] validate_networks() for [('9862f13a-dccf-465d-abda-f29b2d232c04', None, None, None)] {{(pid=102213) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} May 12 14:50:17.025129 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-3b35880e-b6e6-49c9-bb8e-f64a32f3b2f7 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:17.025756 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-3b35880e-b6e6-49c9-bb8e-f64a32f3b2f7 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] [instance: 1f762070-fb47-4d30-9d90-30b0db2dffd4] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:17.046313 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-3b35880e-b6e6-49c9-bb8e-f64a32f3b2f7 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:17.064699 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-3b35880e-b6e6-49c9-bb8e-f64a32f3b2f7 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:17.064699 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-3b35880e-b6e6-49c9-bb8e-f64a32f3b2f7 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:17.064699 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-3b35880e-b6e6-49c9-bb8e-f64a32f3b2f7 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:17.552147 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-3b35880e-b6e6-49c9-bb8e-f64a32f3b2f7 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e423a2656146a7a820f6be3af8d21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c93480a75ab462f9181629c60772257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:17.564182 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-3b35880e-b6e6-49c9-bb8e-f64a32f3b2f7 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] 10.222.0.49 "GET /compute/v2.1/servers/1f762070-fb47-4d30-9d90-30b0db2dffd4" status: 200 len: 1496 microversion: 2.1 time: 0.542418 May 12 14:50:17.589074 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 121/243] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:17 2022] GET /compute/v2.1/servers/1f762070-fb47-4d30-9d90-30b0db2dffd4 => generated 1496 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:50:17.597273 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-17260734-a559-4526-89e7-9bdbaff88cc4 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:17.609133 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-17260734-a559-4526-89e7-9bdbaff88cc4 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:17.619331 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-17260734-a559-4526-89e7-9bdbaff88cc4 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:17.620148 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-17260734-a559-4526-89e7-9bdbaff88cc4 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:17.621402 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-17260734-a559-4526-89e7-9bdbaff88cc4 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:17.622069 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-17260734-a559-4526-89e7-9bdbaff88cc4 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:17.769811 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.virt.hardware [None req-c6958099-1a0d-46d9-9fe6-3c6792f04477 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Flavor limits 0:0:0 {{(pid=102213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 14:50:17.770401 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.virt.hardware [None req-c6958099-1a0d-46d9-9fe6-3c6792f04477 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Image limits 0:0:0 {{(pid=102213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 14:50:17.771174 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.virt.hardware [None req-c6958099-1a0d-46d9-9fe6-3c6792f04477 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Flavor pref 0:0:0 {{(pid=102213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 14:50:17.771625 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.virt.hardware [None req-c6958099-1a0d-46d9-9fe6-3c6792f04477 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Image pref 0:0:0 {{(pid=102213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 14:50:17.773173 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.virt.hardware [None req-c6958099-1a0d-46d9-9fe6-3c6792f04477 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=102213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 14:50:17.786085 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-c6958099-1a0d-46d9-9fe6-3c6792f04477 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:17.786579 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-c6958099-1a0d-46d9-9fe6-3c6792f04477 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:17.787462 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-c6958099-1a0d-46d9-9fe6-3c6792f04477 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:17.787893 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-c6958099-1a0d-46d9-9fe6-3c6792f04477 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:17.810915 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.quota [None req-c6958099-1a0d-46d9-9fe6-3c6792f04477 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Getting quotas for project 67a8451272cc41ebaf1598ed940bf09a. Resources: {'cores', 'ram', 'instances'} {{(pid=102213) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 12 14:50:17.817162 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.quota [None req-c6958099-1a0d-46d9-9fe6-3c6792f04477 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Getting quotas for user 6a641a08648b454780081ecc2e291066 and project 67a8451272cc41ebaf1598ed940bf09a. Resources: {'cores', 'ram', 'instances'} {{(pid=102213) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 12 14:50:17.834065 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-c6958099-1a0d-46d9-9fe6-3c6792f04477 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Going to run 1 instances... {{(pid=102213) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 12 14:50:17.837067 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-c6958099-1a0d-46d9-9fe6-3c6792f04477 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 84ccb759-1bc2-4810-8e46-e34c0c29a0d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a4587ab2-5f51-46a3-a023-0e6778ccaaa1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=102213) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} May 12 14:50:17.938868 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-17260734-a559-4526-89e7-9bdbaff88cc4 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:17.947406 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-17260734-a559-4526-89e7-9bdbaff88cc4 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1" status: 200 len: 1509 microversion: 2.1 time: 0.347806 May 12 14:50:17.947406 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 122/244] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:17 2022] GET /compute/v2.1/servers/d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1 => generated 1509 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:50:18.006372 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-c6958099-1a0d-46d9-9fe6-3c6792f04477 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.319915 May 12 14:50:18.007027 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 123/245] 10.222.0.49 () {60 vars in 1146 bytes} [Thu May 12 14:50:16 2022] POST /compute/v2.1/servers => generated 402 bytes in 1321 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 14:50:18.017580 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-1b080d6b-0ead-4b57-8799-f45721600a27 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:18.018203 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-1b080d6b-0ead-4b57-8799-f45721600a27 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 84ccb759-1bc2-4810-8e46-e34c0c29a0d5] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:18.122142 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-1b080d6b-0ead-4b57-8799-f45721600a27 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a641a08648b454780081ecc2e291066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a8451272cc41ebaf1598ed940bf09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:18.137431 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-1b080d6b-0ead-4b57-8799-f45721600a27 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/84ccb759-1bc2-4810-8e46-e34c0c29a0d5" status: 200 len: 1240 microversion: 2.1 time: 0.123601 May 12 14:50:18.138453 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 123/246] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:18 2022] GET /compute/v2.1/servers/84ccb759-1bc2-4810-8e46-e34c0c29a0d5 => generated 1240 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:50:18.966358 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-39d720db-cc0c-4923-a822-be5eb092d78f tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:18.976728 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-39d720db-cc0c-4923-a822-be5eb092d78f tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:18.992480 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-39d720db-cc0c-4923-a822-be5eb092d78f tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:18.993754 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-39d720db-cc0c-4923-a822-be5eb092d78f tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:18.994738 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-39d720db-cc0c-4923-a822-be5eb092d78f tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:18.995852 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-39d720db-cc0c-4923-a822-be5eb092d78f tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:19.158474 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-f088b11f-e2d8-4437-80dd-93a470929cab tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:19.158474 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-f088b11f-e2d8-4437-80dd-93a470929cab tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 84ccb759-1bc2-4810-8e46-e34c0c29a0d5] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:19.167178 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-f088b11f-e2d8-4437-80dd-93a470929cab tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:19.167631 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-f088b11f-e2d8-4437-80dd-93a470929cab tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:19.168425 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-f088b11f-e2d8-4437-80dd-93a470929cab tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:19.168864 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-f088b11f-e2d8-4437-80dd-93a470929cab tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:19.307329 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-39d720db-cc0c-4923-a822-be5eb092d78f tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:19.321044 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-39d720db-cc0c-4923-a822-be5eb092d78f tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1" status: 200 len: 1509 microversion: 2.1 time: 0.360374 May 12 14:50:19.322317 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 124/247] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:18 2022] GET /compute/v2.1/servers/d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1 => generated 1509 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:50:19.371163 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-f088b11f-e2d8-4437-80dd-93a470929cab tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a641a08648b454780081ecc2e291066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a8451272cc41ebaf1598ed940bf09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:19.379911 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-f088b11f-e2d8-4437-80dd-93a470929cab tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/84ccb759-1bc2-4810-8e46-e34c0c29a0d5" status: 200 len: 1244 microversion: 2.1 time: 0.228963 May 12 14:50:19.380393 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 124/248] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:19 2022] GET /compute/v2.1/servers/84ccb759-1bc2-4810-8e46-e34c0c29a0d5 => generated 1244 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:50:19.388824 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-74fad8e5-372a-47fb-b757-1236ba6557a2 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:19.389612 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-74fad8e5-372a-47fb-b757-1236ba6557a2 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] [instance: 1f762070-fb47-4d30-9d90-30b0db2dffd4] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:19.397748 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-74fad8e5-372a-47fb-b757-1236ba6557a2 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:19.401245 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-74fad8e5-372a-47fb-b757-1236ba6557a2 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:19.402252 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-74fad8e5-372a-47fb-b757-1236ba6557a2 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:19.402912 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-74fad8e5-372a-47fb-b757-1236ba6557a2 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:19.502588 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-74fad8e5-372a-47fb-b757-1236ba6557a2 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] [instance: 1f762070-fb47-4d30-9d90-30b0db2dffd4] Going to try to terminate instance {{(pid=102213) delete /opt/stack/nova/nova/compute/api.py:2562}} May 12 14:50:19.618312 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-669168da-9467-4c70-ac1f-f868572120d8 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:50:19.631173 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-669168da-9467-4c70-ac1f-f868572120d8 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:19.632215 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-669168da-9467-4c70-ac1f-f868572120d8 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:19.714079 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-669168da-9467-4c70-ac1f-f868572120d8 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 3062e66d-4c2a-4212-b186-ecafec6bde2e] Going to try to stop instance {{(pid=102212) force_stop /opt/stack/nova/nova/compute/api.py:2602}} May 12 14:50:19.918837 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-74fad8e5-372a-47fb-b757-1236ba6557a2 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] 10.222.0.49 "DELETE /compute/v2.1/servers/1f762070-fb47-4d30-9d90-30b0db2dffd4" status: 204 len: 0 microversion: 2.1 time: 0.533623 May 12 14:50:19.920025 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 125/249] 10.222.0.49 () {58 vars in 1238 bytes} [Thu May 12 14:50:19 2022] DELETE /compute/v2.1/servers/1f762070-fb47-4d30-9d90-30b0db2dffd4 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 14:50:19.928887 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-1b312c1f-9bb6-49b4-9778-ff1ad97be066 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:19.929899 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-1b312c1f-9bb6-49b4-9778-ff1ad97be066 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] [instance: 1f762070-fb47-4d30-9d90-30b0db2dffd4] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:19.938285 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-1b312c1f-9bb6-49b4-9778-ff1ad97be066 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:19.938832 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-1b312c1f-9bb6-49b4-9778-ff1ad97be066 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:19.939683 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-1b312c1f-9bb6-49b4-9778-ff1ad97be066 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:19.940204 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-1b312c1f-9bb6-49b4-9778-ff1ad97be066 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:20.027592 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-669168da-9467-4c70-ac1f-f868572120d8 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "POST /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e/action" status: 202 len: 0 microversion: 2.1 time: 0.413086 May 12 14:50:20.028419 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 125/250] 10.222.0.49 () {60 vars in 1277 bytes} [Thu May 12 14:50:19 2022] POST /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e/action => generated 0 bytes in 415 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 12 14:50:20.040385 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-6e69362e-65f1-40ca-b002-780e981eb492 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:20.041562 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-6e69362e-65f1-40ca-b002-780e981eb492 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 3062e66d-4c2a-4212-b186-ecafec6bde2e] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:20.052448 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-6e69362e-65f1-40ca-b002-780e981eb492 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:20.052902 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-6e69362e-65f1-40ca-b002-780e981eb492 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:20.058168 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-6e69362e-65f1-40ca-b002-780e981eb492 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:20.058168 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-6e69362e-65f1-40ca-b002-780e981eb492 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:20.199769 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-1b312c1f-9bb6-49b4-9778-ff1ad97be066 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e423a2656146a7a820f6be3af8d21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c93480a75ab462f9181629c60772257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:20.209437 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-1b312c1f-9bb6-49b4-9778-ff1ad97be066 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] 10.222.0.49 "GET /compute/v2.1/servers/1f762070-fb47-4d30-9d90-30b0db2dffd4" status: 200 len: 1502 microversion: 2.1 time: 0.284780 May 12 14:50:20.210384 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 126/251] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:19 2022] GET /compute/v2.1/servers/1f762070-fb47-4d30-9d90-30b0db2dffd4 => generated 1502 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:50:20.310128 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-6e69362e-65f1-40ca-b002-780e981eb492 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e128ca83d6448c9ab1fe7dcc5467d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a090a68e336b4562aca524a95f550e04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:20.319133 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-6e69362e-65f1-40ca-b002-780e981eb492 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e" status: 200 len: 1725 microversion: 2.1 time: 0.285437 May 12 14:50:20.319733 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 126/252] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:20 2022] GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e => generated 1725 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:50:20.338359 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-9915e122-cc19-4a4e-ab01-5fa3c7bdc1e4 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:20.339016 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-9915e122-cc19-4a4e-ab01-5fa3c7bdc1e4 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:20.347105 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-9915e122-cc19-4a4e-ab01-5fa3c7bdc1e4 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:20.348310 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-9915e122-cc19-4a4e-ab01-5fa3c7bdc1e4 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:20.349116 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-9915e122-cc19-4a4e-ab01-5fa3c7bdc1e4 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:20.349719 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-9915e122-cc19-4a4e-ab01-5fa3c7bdc1e4 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:20.397213 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-e6beb136-22b1-4198-a088-bebadd9b295d tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:20.397837 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-e6beb136-22b1-4198-a088-bebadd9b295d tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 84ccb759-1bc2-4810-8e46-e34c0c29a0d5] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:20.405311 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-e6beb136-22b1-4198-a088-bebadd9b295d tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:20.406030 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-e6beb136-22b1-4198-a088-bebadd9b295d tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:20.406982 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-e6beb136-22b1-4198-a088-bebadd9b295d tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:20.407424 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-e6beb136-22b1-4198-a088-bebadd9b295d tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:20.540094 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-e6beb136-22b1-4198-a088-bebadd9b295d tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a641a08648b454780081ecc2e291066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a8451272cc41ebaf1598ed940bf09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:20.550535 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-e6beb136-22b1-4198-a088-bebadd9b295d tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/84ccb759-1bc2-4810-8e46-e34c0c29a0d5" status: 200 len: 1236 microversion: 2.1 time: 0.157466 May 12 14:50:20.552359 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 127/253] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:20 2022] GET /compute/v2.1/servers/84ccb759-1bc2-4810-8e46-e34c0c29a0d5 => generated 1236 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:50:20.575749 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-9915e122-cc19-4a4e-ab01-5fa3c7bdc1e4 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:20.584674 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-9915e122-cc19-4a4e-ab01-5fa3c7bdc1e4 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1" status: 200 len: 1509 microversion: 2.1 time: 0.250021 May 12 14:50:20.585250 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 127/254] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:20 2022] GET /compute/v2.1/servers/d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1 => generated 1509 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:50:21.229903 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-f110f650-0aed-416f-a140-a10ea485cb60 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:21.230796 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-f110f650-0aed-416f-a140-a10ea485cb60 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] [instance: 1f762070-fb47-4d30-9d90-30b0db2dffd4] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:21.246871 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-f110f650-0aed-416f-a140-a10ea485cb60 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:21.247300 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-f110f650-0aed-416f-a140-a10ea485cb60 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:21.248178 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-f110f650-0aed-416f-a140-a10ea485cb60 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:21.248606 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-f110f650-0aed-416f-a140-a10ea485cb60 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:21.338500 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-f6136890-7db9-42cc-961d-cffcedb485b7 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:21.339159 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-f6136890-7db9-42cc-961d-cffcedb485b7 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 3062e66d-4c2a-4212-b186-ecafec6bde2e] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:21.346527 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-f6136890-7db9-42cc-961d-cffcedb485b7 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:21.347208 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-f6136890-7db9-42cc-961d-cffcedb485b7 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:21.347988 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-f6136890-7db9-42cc-961d-cffcedb485b7 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:21.351950 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-f6136890-7db9-42cc-961d-cffcedb485b7 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:21.459713 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-f110f650-0aed-416f-a140-a10ea485cb60 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e423a2656146a7a820f6be3af8d21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c93480a75ab462f9181629c60772257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:21.467546 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-f110f650-0aed-416f-a140-a10ea485cb60 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] 10.222.0.49 "GET /compute/v2.1/servers/1f762070-fb47-4d30-9d90-30b0db2dffd4" status: 200 len: 1502 microversion: 2.1 time: 0.241220 May 12 14:50:21.468117 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 128/255] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:21 2022] GET /compute/v2.1/servers/1f762070-fb47-4d30-9d90-30b0db2dffd4 => generated 1502 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:50:21.545119 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-f6136890-7db9-42cc-961d-cffcedb485b7 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e128ca83d6448c9ab1fe7dcc5467d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a090a68e336b4562aca524a95f550e04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:21.554168 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-f6136890-7db9-42cc-961d-cffcedb485b7 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e" status: 200 len: 1725 microversion: 2.1 time: 0.219870 May 12 14:50:21.554738 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 128/256] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:21 2022] GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e => generated 1725 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:50:21.568946 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-72154935-dd8f-429d-9397-4e4b50b64157 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:21.569654 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-72154935-dd8f-429d-9397-4e4b50b64157 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 84ccb759-1bc2-4810-8e46-e34c0c29a0d5] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:21.577750 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-72154935-dd8f-429d-9397-4e4b50b64157 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:21.578289 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-72154935-dd8f-429d-9397-4e4b50b64157 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:21.579229 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-72154935-dd8f-429d-9397-4e4b50b64157 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:21.579735 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-72154935-dd8f-429d-9397-4e4b50b64157 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:21.601803 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-e6ea79ad-e1eb-497f-911d-b2cac1fbf441 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:21.602608 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-e6ea79ad-e1eb-497f-911d-b2cac1fbf441 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:21.614027 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e6ea79ad-e1eb-497f-911d-b2cac1fbf441 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:21.614565 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e6ea79ad-e1eb-497f-911d-b2cac1fbf441 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:21.620601 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e6ea79ad-e1eb-497f-911d-b2cac1fbf441 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:21.620601 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e6ea79ad-e1eb-497f-911d-b2cac1fbf441 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:21.713521 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-72154935-dd8f-429d-9397-4e4b50b64157 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a641a08648b454780081ecc2e291066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a8451272cc41ebaf1598ed940bf09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:21.721734 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-72154935-dd8f-429d-9397-4e4b50b64157 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/84ccb759-1bc2-4810-8e46-e34c0c29a0d5" status: 200 len: 1236 microversion: 2.1 time: 0.156418 May 12 14:50:21.722312 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 129/257] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:21 2022] GET /compute/v2.1/servers/84ccb759-1bc2-4810-8e46-e34c0c29a0d5 => generated 1236 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:50:21.884799 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-e6ea79ad-e1eb-497f-911d-b2cac1fbf441 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:21.892974 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-e6ea79ad-e1eb-497f-911d-b2cac1fbf441 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1" status: 200 len: 1509 microversion: 2.1 time: 0.295120 May 12 14:50:21.893537 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 129/258] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:21 2022] GET /compute/v2.1/servers/d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1 => generated 1509 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:50:22.484185 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-a527067b-5793-4ebe-86da-8c30b21948e8 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:22.484798 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-a527067b-5793-4ebe-86da-8c30b21948e8 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] [instance: 1f762070-fb47-4d30-9d90-30b0db2dffd4] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:22.493940 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-a527067b-5793-4ebe-86da-8c30b21948e8 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:22.494394 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-a527067b-5793-4ebe-86da-8c30b21948e8 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:22.495439 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-a527067b-5793-4ebe-86da-8c30b21948e8 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:22.495625 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-a527067b-5793-4ebe-86da-8c30b21948e8 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:22.572065 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-a2846afe-db17-4089-9f78-7454d545128f tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:22.572686 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-a2846afe-db17-4089-9f78-7454d545128f tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 3062e66d-4c2a-4212-b186-ecafec6bde2e] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:22.579899 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-a2846afe-db17-4089-9f78-7454d545128f tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:22.580342 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-a2846afe-db17-4089-9f78-7454d545128f tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:22.581110 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-a2846afe-db17-4089-9f78-7454d545128f tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:22.581539 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-a2846afe-db17-4089-9f78-7454d545128f tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:22.708640 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-a527067b-5793-4ebe-86da-8c30b21948e8 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e423a2656146a7a820f6be3af8d21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c93480a75ab462f9181629c60772257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:22.716852 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-a527067b-5793-4ebe-86da-8c30b21948e8 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] 10.222.0.49 "GET /compute/v2.1/servers/1f762070-fb47-4d30-9d90-30b0db2dffd4" status: 200 len: 1502 microversion: 2.1 time: 0.236287 May 12 14:50:22.717536 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 130/259] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:22 2022] GET /compute/v2.1/servers/1f762070-fb47-4d30-9d90-30b0db2dffd4 => generated 1502 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:50:22.737872 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-4fcfbbc5-2b2c-4cf7-b81b-1e374b95388d tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:22.738527 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-4fcfbbc5-2b2c-4cf7-b81b-1e374b95388d tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 84ccb759-1bc2-4810-8e46-e34c0c29a0d5] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:22.746526 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-4fcfbbc5-2b2c-4cf7-b81b-1e374b95388d tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:22.746995 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-4fcfbbc5-2b2c-4cf7-b81b-1e374b95388d tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:22.747766 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-4fcfbbc5-2b2c-4cf7-b81b-1e374b95388d tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:22.748206 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-4fcfbbc5-2b2c-4cf7-b81b-1e374b95388d tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:22.803183 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-a2846afe-db17-4089-9f78-7454d545128f tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e128ca83d6448c9ab1fe7dcc5467d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a090a68e336b4562aca524a95f550e04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:22.814524 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-a2846afe-db17-4089-9f78-7454d545128f tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e" status: 200 len: 1725 microversion: 2.1 time: 0.245990 May 12 14:50:22.815074 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 130/260] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:22 2022] GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e => generated 1725 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:50:22.867302 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-4fcfbbc5-2b2c-4cf7-b81b-1e374b95388d tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a641a08648b454780081ecc2e291066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a8451272cc41ebaf1598ed940bf09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:22.885875 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-4fcfbbc5-2b2c-4cf7-b81b-1e374b95388d tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/84ccb759-1bc2-4810-8e46-e34c0c29a0d5" status: 200 len: 1236 microversion: 2.1 time: 0.151532 May 12 14:50:22.886465 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 131/261] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:22 2022] GET /compute/v2.1/servers/84ccb759-1bc2-4810-8e46-e34c0c29a0d5 => generated 1236 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:50:22.910198 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-87b8bddb-5530-4ffb-9ca4-c2012ae57702 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:22.910844 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-87b8bddb-5530-4ffb-9ca4-c2012ae57702 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:22.919787 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-87b8bddb-5530-4ffb-9ca4-c2012ae57702 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:22.920432 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-87b8bddb-5530-4ffb-9ca4-c2012ae57702 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:22.921304 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-87b8bddb-5530-4ffb-9ca4-c2012ae57702 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:22.921809 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-87b8bddb-5530-4ffb-9ca4-c2012ae57702 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:23.119212 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-87b8bddb-5530-4ffb-9ca4-c2012ae57702 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:23.130268 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-87b8bddb-5530-4ffb-9ca4-c2012ae57702 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1" status: 200 len: 1509 microversion: 2.1 time: 0.224570 May 12 14:50:23.130876 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 131/262] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:22 2022] GET /compute/v2.1/servers/d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1 => generated 1509 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:50:23.733178 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-95ee398c-5c08-4a84-9a2b-08a533414507 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:23.733827 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-95ee398c-5c08-4a84-9a2b-08a533414507 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] [instance: 1f762070-fb47-4d30-9d90-30b0db2dffd4] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:23.745193 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-95ee398c-5c08-4a84-9a2b-08a533414507 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:23.745193 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-95ee398c-5c08-4a84-9a2b-08a533414507 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:23.745193 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-95ee398c-5c08-4a84-9a2b-08a533414507 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:23.745193 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-95ee398c-5c08-4a84-9a2b-08a533414507 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:23.831263 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-894f8cf6-532a-4b95-b3df-a0e3b24c6121 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:23.831933 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-894f8cf6-532a-4b95-b3df-a0e3b24c6121 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 3062e66d-4c2a-4212-b186-ecafec6bde2e] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:23.839423 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-894f8cf6-532a-4b95-b3df-a0e3b24c6121 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:23.840524 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-894f8cf6-532a-4b95-b3df-a0e3b24c6121 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:23.841766 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-894f8cf6-532a-4b95-b3df-a0e3b24c6121 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:23.842217 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-894f8cf6-532a-4b95-b3df-a0e3b24c6121 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:24.058461 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-894f8cf6-532a-4b95-b3df-a0e3b24c6121 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e128ca83d6448c9ab1fe7dcc5467d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a090a68e336b4562aca524a95f550e04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:24.067237 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-894f8cf6-532a-4b95-b3df-a0e3b24c6121 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e" status: 200 len: 1725 microversion: 2.1 time: 0.239772 May 12 14:50:24.067823 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 132/263] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:23 2022] GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e => generated 1725 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:50:24.072430 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-d2560777-3352-413b-8afa-3e5ec9eff910 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:24.073039 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-d2560777-3352-413b-8afa-3e5ec9eff910 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 84ccb759-1bc2-4810-8e46-e34c0c29a0d5] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:24.080101 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-d2560777-3352-413b-8afa-3e5ec9eff910 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:24.080554 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-d2560777-3352-413b-8afa-3e5ec9eff910 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:24.081386 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-d2560777-3352-413b-8afa-3e5ec9eff910 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:24.081768 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-d2560777-3352-413b-8afa-3e5ec9eff910 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:24.090976 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-95ee398c-5c08-4a84-9a2b-08a533414507 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e423a2656146a7a820f6be3af8d21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c93480a75ab462f9181629c60772257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:24.099368 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-95ee398c-5c08-4a84-9a2b-08a533414507 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] 10.222.0.49 "GET /compute/v2.1/servers/1f762070-fb47-4d30-9d90-30b0db2dffd4" status: 200 len: 1502 microversion: 2.1 time: 0.369737 May 12 14:50:24.100446 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 132/264] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:23 2022] GET /compute/v2.1/servers/1f762070-fb47-4d30-9d90-30b0db2dffd4 => generated 1502 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:50:24.148805 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-61679fe2-078a-46f4-8f5a-0b0973c37703 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:24.149713 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-61679fe2-078a-46f4-8f5a-0b0973c37703 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:24.175367 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-61679fe2-078a-46f4-8f5a-0b0973c37703 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:24.176612 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-61679fe2-078a-46f4-8f5a-0b0973c37703 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:24.177545 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-61679fe2-078a-46f4-8f5a-0b0973c37703 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:24.178064 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-61679fe2-078a-46f4-8f5a-0b0973c37703 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:24.205635 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-d2560777-3352-413b-8afa-3e5ec9eff910 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a641a08648b454780081ecc2e291066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a8451272cc41ebaf1598ed940bf09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:24.218888 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-d2560777-3352-413b-8afa-3e5ec9eff910 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/84ccb759-1bc2-4810-8e46-e34c0c29a0d5" status: 200 len: 1300 microversion: 2.1 time: 0.146352 May 12 14:50:24.227617 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 133/265] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:24 2022] GET /compute/v2.1/servers/84ccb759-1bc2-4810-8e46-e34c0c29a0d5 => generated 1300 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:50:24.520608 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-61679fe2-078a-46f4-8f5a-0b0973c37703 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:24.529202 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-61679fe2-078a-46f4-8f5a-0b0973c37703 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1" status: 200 len: 1515 microversion: 2.1 time: 0.384479 May 12 14:50:24.529775 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 133/266] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:24 2022] GET /compute/v2.1/servers/d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1 => generated 1515 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:50:25.084634 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-c45a52ac-d66a-4943-ad38-a7b491548fe9 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:25.085291 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-c45a52ac-d66a-4943-ad38-a7b491548fe9 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 3062e66d-4c2a-4212-b186-ecafec6bde2e] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:25.093391 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-c45a52ac-d66a-4943-ad38-a7b491548fe9 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:25.098676 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-c45a52ac-d66a-4943-ad38-a7b491548fe9 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:25.098676 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-c45a52ac-d66a-4943-ad38-a7b491548fe9 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:25.098676 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-c45a52ac-d66a-4943-ad38-a7b491548fe9 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:25.123392 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-64ea914b-b6b3-4cbf-9f4b-22f4da34dace tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:25.126056 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-64ea914b-b6b3-4cbf-9f4b-22f4da34dace tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] [instance: 1f762070-fb47-4d30-9d90-30b0db2dffd4] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:25.140155 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-64ea914b-b6b3-4cbf-9f4b-22f4da34dace tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:25.141547 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-64ea914b-b6b3-4cbf-9f4b-22f4da34dace tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:25.143163 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-64ea914b-b6b3-4cbf-9f4b-22f4da34dace tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:25.144104 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-64ea914b-b6b3-4cbf-9f4b-22f4da34dace tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:25.457792 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-c45a52ac-d66a-4943-ad38-a7b491548fe9 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e128ca83d6448c9ab1fe7dcc5467d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a090a68e336b4562aca524a95f550e04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:25.468557 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-c45a52ac-d66a-4943-ad38-a7b491548fe9 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e" status: 200 len: 1725 microversion: 2.1 time: 0.387407 May 12 14:50:25.480389 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 134/267] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:25 2022] GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e => generated 1725 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:50:25.480389 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-dd31e33b-7ef0-4327-a957-cc7e52be04dd tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:25.480389 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-dd31e33b-7ef0-4327-a957-cc7e52be04dd tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 84ccb759-1bc2-4810-8e46-e34c0c29a0d5] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:25.501360 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-dd31e33b-7ef0-4327-a957-cc7e52be04dd tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:25.501850 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-dd31e33b-7ef0-4327-a957-cc7e52be04dd tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:25.504879 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-dd31e33b-7ef0-4327-a957-cc7e52be04dd tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:25.505816 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-dd31e33b-7ef0-4327-a957-cc7e52be04dd tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:25.894046 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-dd31e33b-7ef0-4327-a957-cc7e52be04dd tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a641a08648b454780081ecc2e291066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a8451272cc41ebaf1598ed940bf09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:25.903429 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-dd31e33b-7ef0-4327-a957-cc7e52be04dd tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/84ccb759-1bc2-4810-8e46-e34c0c29a0d5" status: 200 len: 1366 microversion: 2.1 time: 0.430063 May 12 14:50:25.912206 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 135/268] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:25 2022] GET /compute/v2.1/servers/84ccb759-1bc2-4810-8e46-e34c0c29a0d5 => generated 1366 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:50:25.971500 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-64ea914b-b6b3-4cbf-9f4b-22f4da34dace tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e423a2656146a7a820f6be3af8d21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c93480a75ab462f9181629c60772257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:25.980638 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-64ea914b-b6b3-4cbf-9f4b-22f4da34dace tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] 10.222.0.49 "GET /compute/v2.1/servers/1f762070-fb47-4d30-9d90-30b0db2dffd4" status: 200 len: 1502 microversion: 2.1 time: 0.865999 May 12 14:50:25.981272 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 134/269] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:25 2022] GET /compute/v2.1/servers/1f762070-fb47-4d30-9d90-30b0db2dffd4 => generated 1502 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:50:26.487255 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-fafaba43-4dc8-416d-b82a-889bc2673550 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:26.487821 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-fafaba43-4dc8-416d-b82a-889bc2673550 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 3062e66d-4c2a-4212-b186-ecafec6bde2e] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:26.495302 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-fafaba43-4dc8-416d-b82a-889bc2673550 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:26.495720 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-fafaba43-4dc8-416d-b82a-889bc2673550 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:26.496494 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-fafaba43-4dc8-416d-b82a-889bc2673550 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:26.496929 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-fafaba43-4dc8-416d-b82a-889bc2673550 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:26.706506 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-6731575a-b725-42b6-9391-de6d3e513095 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Action: 'create', calling method: .version_select at 0x7ff77e947a60>, body: {"keypair": {"name": "tempest-keypair-1503865316", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM85Di3WPDiVYGYHO5Ki4wQ1PksmmlJIghl8pynp0K6tSPCTFCEZRJIQJ+Yt7+kYb4+QkGl+j0AaaRDyPL2cB9dP5Ol4HJX8cxo46aZ9trrZOXJ83sGvRLobKNIrryh1Kw=="}} {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:50:26.752237 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-fafaba43-4dc8-416d-b82a-889bc2673550 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e128ca83d6448c9ab1fe7dcc5467d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a090a68e336b4562aca524a95f550e04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:26.761326 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.quota [None req-6731575a-b725-42b6-9391-de6d3e513095 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Getting quotas for project 0301badcd92e4cc483246a0fa4949060. Resources: {'key_pairs'} {{(pid=102212) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 12 14:50:26.764058 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-fafaba43-4dc8-416d-b82a-889bc2673550 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e" status: 200 len: 1725 microversion: 2.1 time: 0.280761 May 12 14:50:26.773538 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 136/270] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:26 2022] GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e => generated 1725 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:50:26.776392 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.quota [None req-6731575a-b725-42b6-9391-de6d3e513095 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Getting quotas for user ccce5e3f8320498ea48fa16c7d811ee1 and project 0301badcd92e4cc483246a0fa4949060. Resources: {'key_pairs'} {{(pid=102212) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 12 14:50:26.880761 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-6731575a-b725-42b6-9391-de6d3e513095 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.179368 May 12 14:50:26.881676 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 135/271] 10.222.0.49 () {60 vars in 1158 bytes} [Thu May 12 14:50:26 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:50:26.922777 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-f27bbe6a-2606-4cfd-a01b-d6f634264bd1 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:26.923502 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-f27bbe6a-2606-4cfd-a01b-d6f634264bd1 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 84ccb759-1bc2-4810-8e46-e34c0c29a0d5] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:26.931489 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-f27bbe6a-2606-4cfd-a01b-d6f634264bd1 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:26.937301 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-f27bbe6a-2606-4cfd-a01b-d6f634264bd1 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:26.937301 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-f27bbe6a-2606-4cfd-a01b-d6f634264bd1 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:26.937301 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-f27bbe6a-2606-4cfd-a01b-d6f634264bd1 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:26.998986 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-b00ed023-8e1b-4673-8347-3acc0f31c408 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:26.998986 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-b00ed023-8e1b-4673-8347-3acc0f31c408 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] [instance: 1f762070-fb47-4d30-9d90-30b0db2dffd4] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:27.011036 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-b00ed023-8e1b-4673-8347-3acc0f31c408 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:27.011586 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-b00ed023-8e1b-4673-8347-3acc0f31c408 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:27.012403 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-b00ed023-8e1b-4673-8347-3acc0f31c408 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:27.012868 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-b00ed023-8e1b-4673-8347-3acc0f31c408 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:27.322487 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-f27bbe6a-2606-4cfd-a01b-d6f634264bd1 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a641a08648b454780081ecc2e291066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a8451272cc41ebaf1598ed940bf09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:27.322487 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-f27bbe6a-2606-4cfd-a01b-d6f634264bd1 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/84ccb759-1bc2-4810-8e46-e34c0c29a0d5" status: 200 len: 1366 microversion: 2.1 time: 0.385810 May 12 14:50:27.322487 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 137/272] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:26 2022] GET /compute/v2.1/servers/84ccb759-1bc2-4810-8e46-e34c0c29a0d5 => generated 1366 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:50:27.410126 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [req-74d362f5-1083-4dda-9423-dcb68274bad7 req-f5a668e7-220e-47de-be5e-1f5cdb3e52ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f762070-fb47-4d30-9d90-30b0db2dffd4", "name": "network-vif-deleted", "tag": "8d88c3a6-67ec-4ff0-9f45-2f453178c148"}]} {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:50:27.411800 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:50:27.411800 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: warnings.warn(msg) May 12 14:50:27.421526 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [req-74d362f5-1083-4dda-9423-dcb68274bad7 req-f5a668e7-220e-47de-be5e-1f5cdb3e52ba service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:27.422085 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [req-74d362f5-1083-4dda-9423-dcb68274bad7 req-f5a668e7-220e-47de-be5e-1f5cdb3e52ba service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:27.438791 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.compute.server_external_events [req-74d362f5-1083-4dda-9423-dcb68274bad7 req-f5a668e7-220e-47de-be5e-1f5cdb3e52ba service nova] Creating event network-vif-deleted:8d88c3a6-67ec-4ff0-9f45-2f453178c148 for instance 1f762070-fb47-4d30-9d90-30b0db2dffd4 on hv-cinder-83118 May 12 14:50:27.444127 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [req-74d362f5-1083-4dda-9423-dcb68274bad7 req-f5a668e7-220e-47de-be5e-1f5cdb3e52ba service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038006 May 12 14:50:27.445258 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 138/273] 10.222.0.49 () {64 vars in 1317 bytes} [Thu May 12 14:50:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:50:27.719967 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-b00ed023-8e1b-4673-8347-3acc0f31c408 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e423a2656146a7a820f6be3af8d21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c93480a75ab462f9181629c60772257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:27.733848 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-b00ed023-8e1b-4673-8347-3acc0f31c408 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] 10.222.0.49 "GET /compute/v2.1/servers/1f762070-fb47-4d30-9d90-30b0db2dffd4" status: 200 len: 1502 microversion: 2.1 time: 0.739998 May 12 14:50:27.734495 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 136/274] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:26 2022] GET /compute/v2.1/servers/1f762070-fb47-4d30-9d90-30b0db2dffd4 => generated 1502 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:50:27.782667 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-08bf7209-089c-4319-aa98-d41aadeba7a2 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:27.783969 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-08bf7209-089c-4319-aa98-d41aadeba7a2 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 3062e66d-4c2a-4212-b186-ecafec6bde2e] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:27.792334 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-08bf7209-089c-4319-aa98-d41aadeba7a2 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:27.792917 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-08bf7209-089c-4319-aa98-d41aadeba7a2 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:27.794311 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-08bf7209-089c-4319-aa98-d41aadeba7a2 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:27.795050 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-08bf7209-089c-4319-aa98-d41aadeba7a2 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:28.090706 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-08bf7209-089c-4319-aa98-d41aadeba7a2 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e128ca83d6448c9ab1fe7dcc5467d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a090a68e336b4562aca524a95f550e04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:28.099995 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-08bf7209-089c-4319-aa98-d41aadeba7a2 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e" status: 200 len: 1725 microversion: 2.1 time: 0.322512 May 12 14:50:28.100764 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 139/275] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:27 2022] GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e => generated 1725 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:50:28.323090 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-3313be0e-aa25-409f-87b4-f0ab245a3ac2 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:28.323729 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-3313be0e-aa25-409f-87b4-f0ab245a3ac2 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 84ccb759-1bc2-4810-8e46-e34c0c29a0d5] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:28.336677 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-3313be0e-aa25-409f-87b4-f0ab245a3ac2 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:28.340048 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-3313be0e-aa25-409f-87b4-f0ab245a3ac2 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:28.340048 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-3313be0e-aa25-409f-87b4-f0ab245a3ac2 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:28.340048 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-3313be0e-aa25-409f-87b4-f0ab245a3ac2 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:28.752005 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-4b48d167-ea4b-4528-bd93-b60c20a4ee54 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:28.752614 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-4b48d167-ea4b-4528-bd93-b60c20a4ee54 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] [instance: 1f762070-fb47-4d30-9d90-30b0db2dffd4] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:28.777954 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-4b48d167-ea4b-4528-bd93-b60c20a4ee54 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:28.778412 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-4b48d167-ea4b-4528-bd93-b60c20a4ee54 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:28.779256 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-4b48d167-ea4b-4528-bd93-b60c20a4ee54 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:28.779704 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-4b48d167-ea4b-4528-bd93-b60c20a4ee54 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:28.872177 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-3313be0e-aa25-409f-87b4-f0ab245a3ac2 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a641a08648b454780081ecc2e291066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a8451272cc41ebaf1598ed940bf09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:28.880946 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-3313be0e-aa25-409f-87b4-f0ab245a3ac2 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/84ccb759-1bc2-4810-8e46-e34c0c29a0d5" status: 200 len: 1366 microversion: 2.1 time: 0.562072 May 12 14:50:28.885652 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 137/276] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:28 2022] GET /compute/v2.1/servers/84ccb759-1bc2-4810-8e46-e34c0c29a0d5 => generated 1366 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:50:28.894253 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-4b48d167-ea4b-4528-bd93-b60c20a4ee54 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:28.894764 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-4b48d167-ea4b-4528-bd93-b60c20a4ee54 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:28.895195 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.objects.instance [None req-4b48d167-ea4b-4528-bd93-b60c20a4ee54 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lazy-loading 'fault' on Instance uuid 1f762070-fb47-4d30-9d90-30b0db2dffd4 {{(pid=102213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 12 14:50:28.980300 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-4b48d167-ea4b-4528-bd93-b60c20a4ee54 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e423a2656146a7a820f6be3af8d21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c93480a75ab462f9181629c60772257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:28.989753 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-4b48d167-ea4b-4528-bd93-b60c20a4ee54 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] 10.222.0.49 "GET /compute/v2.1/servers/1f762070-fb47-4d30-9d90-30b0db2dffd4" status: 200 len: 1303 microversion: 2.1 time: 0.241268 May 12 14:50:28.991032 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 140/277] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:28 2022] GET /compute/v2.1/servers/1f762070-fb47-4d30-9d90-30b0db2dffd4 => generated 1303 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:50:29.117480 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-10d8d569-53f0-4a1c-8a42-f66db402d596 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:29.118093 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-10d8d569-53f0-4a1c-8a42-f66db402d596 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 3062e66d-4c2a-4212-b186-ecafec6bde2e] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:29.125376 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-10d8d569-53f0-4a1c-8a42-f66db402d596 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:29.125839 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-10d8d569-53f0-4a1c-8a42-f66db402d596 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:29.126620 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-10d8d569-53f0-4a1c-8a42-f66db402d596 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:29.127083 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-10d8d569-53f0-4a1c-8a42-f66db402d596 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:29.335773 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-10d8d569-53f0-4a1c-8a42-f66db402d596 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e128ca83d6448c9ab1fe7dcc5467d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a090a68e336b4562aca524a95f550e04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:29.349623 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-10d8d569-53f0-4a1c-8a42-f66db402d596 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e" status: 200 len: 1725 microversion: 2.1 time: 0.235885 May 12 14:50:29.350228 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 138/278] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:29 2022] GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e => generated 1725 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:50:29.482711 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [req-b0319de5-fed5-4649-946f-4725bdbff91e req-dd9cbc7a-2937-46e7-b006-c2cd455fa828 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84ccb759-1bc2-4810-8e46-e34c0c29a0d5", "tag": "941ee56d-a8a8-4017-bba8-1c38eaac468b"}]} {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:50:29.484247 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:50:29.484247 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: warnings.warn(msg) May 12 14:50:29.492337 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [req-b0319de5-fed5-4649-946f-4725bdbff91e req-dd9cbc7a-2937-46e7-b006-c2cd455fa828 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:29.493336 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [req-b0319de5-fed5-4649-946f-4725bdbff91e req-dd9cbc7a-2937-46e7-b006-c2cd455fa828 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:29.508542 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.compute.server_external_events [req-b0319de5-fed5-4649-946f-4725bdbff91e req-dd9cbc7a-2937-46e7-b006-c2cd455fa828 service nova] Creating event network-changed:941ee56d-a8a8-4017-bba8-1c38eaac468b for instance 84ccb759-1bc2-4810-8e46-e34c0c29a0d5 on hv-cinder-83118 May 12 14:50:29.513330 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [req-b0319de5-fed5-4649-946f-4725bdbff91e req-dd9cbc7a-2937-46e7-b006-c2cd455fa828 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034246 May 12 14:50:29.514078 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 141/279] 10.222.0.49 () {64 vars in 1317 bytes} [Thu May 12 14:50:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:50:29.897998 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-4cca446f-9360-4a4d-8ac8-6e30da22941f tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:29.899138 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-4cca446f-9360-4a4d-8ac8-6e30da22941f tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 84ccb759-1bc2-4810-8e46-e34c0c29a0d5] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:29.907806 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-4cca446f-9360-4a4d-8ac8-6e30da22941f tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:29.908346 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-4cca446f-9360-4a4d-8ac8-6e30da22941f tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:29.909349 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-4cca446f-9360-4a4d-8ac8-6e30da22941f tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:29.910142 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-4cca446f-9360-4a4d-8ac8-6e30da22941f tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:30.013676 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-731fddc7-ff54-407c-ad2a-7683640928b8 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:30.014304 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-731fddc7-ff54-407c-ad2a-7683640928b8 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] [instance: 1f762070-fb47-4d30-9d90-30b0db2dffd4] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:30.022043 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-731fddc7-ff54-407c-ad2a-7683640928b8 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:30.022660 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-731fddc7-ff54-407c-ad2a-7683640928b8 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:30.023708 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-731fddc7-ff54-407c-ad2a-7683640928b8 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:30.024297 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-731fddc7-ff54-407c-ad2a-7683640928b8 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:30.083620 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.wsgi [None req-731fddc7-ff54-407c-ad2a-7683640928b8 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] HTTP exception thrown: Instance 1f762070-fb47-4d30-9d90-30b0db2dffd4 could not be found. May 12 14:50:30.084236 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-731fddc7-ff54-407c-ad2a-7683640928b8 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Returning 404 to user: Instance 1f762070-fb47-4d30-9d90-30b0db2dffd4 could not be found. {{(pid=102213) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 12 14:50:30.085080 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-731fddc7-ff54-407c-ad2a-7683640928b8 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] 10.222.0.49 "GET /compute/v2.1/servers/1f762070-fb47-4d30-9d90-30b0db2dffd4" status: 404 len: 111 microversion: 2.1 time: 0.081780 May 12 14:50:30.085649 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 142/280] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:30 2022] GET /compute/v2.1/servers/1f762070-fb47-4d30-9d90-30b0db2dffd4 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 12 14:50:30.249147 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-8896bf8f-de77-4af8-bddd-0f3e997d3057 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-17785549", "imageRef": "a4587ab2-5f51-46a3-a023-0e6778ccaaa1", "flavorRef": "452", "networks": [{"uuid": "29318bea-5e26-4915-918a-926b02b62ecd"}]}} {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:50:30.286997 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-4cca446f-9360-4a4d-8ac8-6e30da22941f tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a641a08648b454780081ecc2e291066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a8451272cc41ebaf1598ed940bf09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:30.295765 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-4cca446f-9360-4a4d-8ac8-6e30da22941f tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/84ccb759-1bc2-4810-8e46-e34c0c29a0d5" status: 200 len: 1366 microversion: 2.1 time: 0.401986 May 12 14:50:30.296644 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 139/281] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:29 2022] GET /compute/v2.1/servers/84ccb759-1bc2-4810-8e46-e34c0c29a0d5 => generated 1366 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:50:30.327401 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.network.neutron [None req-8896bf8f-de77-4af8-bddd-0f3e997d3057 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] validate_networks() for [('29318bea-5e26-4915-918a-926b02b62ecd', None, None, None)] {{(pid=102213) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} May 12 14:50:30.369244 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-e9c20f2e-cd7d-4e07-8ab5-08091482a695 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:30.370327 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-e9c20f2e-cd7d-4e07-8ab5-08091482a695 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 3062e66d-4c2a-4212-b186-ecafec6bde2e] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:30.380474 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-e9c20f2e-cd7d-4e07-8ab5-08091482a695 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:30.381665 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-e9c20f2e-cd7d-4e07-8ab5-08091482a695 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:30.382878 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-e9c20f2e-cd7d-4e07-8ab5-08091482a695 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:30.384052 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-e9c20f2e-cd7d-4e07-8ab5-08091482a695 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:30.731012 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-e9c20f2e-cd7d-4e07-8ab5-08091482a695 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e128ca83d6448c9ab1fe7dcc5467d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a090a68e336b4562aca524a95f550e04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:30.739977 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-e9c20f2e-cd7d-4e07-8ab5-08091482a695 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e" status: 200 len: 1725 microversion: 2.1 time: 0.376379 May 12 14:50:30.740544 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 140/282] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:30 2022] GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e => generated 1725 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:50:30.748713 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-aeace717-260c-423a-aa70-f533f10601c0 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-39285716", "imageRef": "a4587ab2-5f51-46a3-a023-0e6778ccaaa1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "faf0fd87-b01d-4638-a1db-c3f32b222877"}], "security_groups": [{"name": "tempest-securitygroup--363761501"}], "key_name": "tempest-keypair-1503865316", "user_data": "}} {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:50:30.874505 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.network.neutron [None req-aeace717-260c-423a-aa70-f533f10601c0 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] validate_networks() for [('faf0fd87-b01d-4638-a1db-c3f32b222877', None, None, None)] {{(pid=102212) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} May 12 14:50:30.952561 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.virt.hardware [None req-8896bf8f-de77-4af8-bddd-0f3e997d3057 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Flavor limits 0:0:0 {{(pid=102213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 14:50:30.953039 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.virt.hardware [None req-8896bf8f-de77-4af8-bddd-0f3e997d3057 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Image limits 0:0:0 {{(pid=102213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 14:50:30.953512 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.virt.hardware [None req-8896bf8f-de77-4af8-bddd-0f3e997d3057 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Flavor pref 0:0:0 {{(pid=102213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 14:50:30.953924 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.virt.hardware [None req-8896bf8f-de77-4af8-bddd-0f3e997d3057 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Image pref 0:0:0 {{(pid=102213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 14:50:30.954367 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.virt.hardware [None req-8896bf8f-de77-4af8-bddd-0f3e997d3057 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=102213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 14:50:30.967292 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-8896bf8f-de77-4af8-bddd-0f3e997d3057 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:30.967741 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-8896bf8f-de77-4af8-bddd-0f3e997d3057 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:30.968550 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-8896bf8f-de77-4af8-bddd-0f3e997d3057 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:30.968990 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-8896bf8f-de77-4af8-bddd-0f3e997d3057 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:30.989260 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.quota [None req-8896bf8f-de77-4af8-bddd-0f3e997d3057 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Getting quotas for project 2c93480a75ab462f9181629c60772257. Resources: {'cores', 'ram', 'instances'} {{(pid=102213) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 12 14:50:30.993260 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.quota [None req-8896bf8f-de77-4af8-bddd-0f3e997d3057 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Getting quotas for user a6e423a2656146a7a820f6be3af8d21c and project 2c93480a75ab462f9181629c60772257. Resources: {'cores', 'ram', 'instances'} {{(pid=102213) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 12 14:50:31.004089 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-8896bf8f-de77-4af8-bddd-0f3e997d3057 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Going to run 1 instances... {{(pid=102213) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 12 14:50:31.006378 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-8896bf8f-de77-4af8-bddd-0f3e997d3057 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] [instance: 68b3c2de-3257-4c79-ad68-f4fea7bfde20] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a4587ab2-5f51-46a3-a023-0e6778ccaaa1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=102213) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} May 12 14:50:31.169031 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-8896bf8f-de77-4af8-bddd-0f3e997d3057 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.924414 May 12 14:50:31.171124 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 143/283] 10.222.0.49 () {60 vars in 1146 bytes} [Thu May 12 14:50:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 927 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 12 14:50:31.183698 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-59c33866-d0ea-44e0-9755-1d1544dee3cf tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:31.186289 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-59c33866-d0ea-44e0-9755-1d1544dee3cf tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] [instance: 68b3c2de-3257-4c79-ad68-f4fea7bfde20] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:31.334281 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-59c33866-d0ea-44e0-9755-1d1544dee3cf tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e423a2656146a7a820f6be3af8d21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c93480a75ab462f9181629c60772257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:31.346062 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-59c33866-d0ea-44e0-9755-1d1544dee3cf tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] 10.222.0.49 "GET /compute/v2.1/servers/68b3c2de-3257-4c79-ad68-f4fea7bfde20" status: 200 len: 1212 microversion: 2.1 time: 0.166595 May 12 14:50:31.346062 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 144/284] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:31 2022] GET /compute/v2.1/servers/68b3c2de-3257-4c79-ad68-f4fea7bfde20 => generated 1212 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:50:31.359925 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-4c2419c2-4378-44c6-aadd-41751fb089ac tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:31.360539 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-4c2419c2-4378-44c6-aadd-41751fb089ac tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 84ccb759-1bc2-4810-8e46-e34c0c29a0d5] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:31.368493 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-4c2419c2-4378-44c6-aadd-41751fb089ac tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:31.368946 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-4c2419c2-4378-44c6-aadd-41751fb089ac tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:31.369724 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-4c2419c2-4378-44c6-aadd-41751fb089ac tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:31.370152 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-4c2419c2-4378-44c6-aadd-41751fb089ac tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:31.535006 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.virt.hardware [None req-aeace717-260c-423a-aa70-f533f10601c0 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Flavor limits 0:0:0 {{(pid=102212) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 14:50:31.540954 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.virt.hardware [None req-aeace717-260c-423a-aa70-f533f10601c0 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Image limits 0:0:0 {{(pid=102212) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 14:50:31.540954 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.virt.hardware [None req-aeace717-260c-423a-aa70-f533f10601c0 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Flavor pref 0:0:0 {{(pid=102212) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 14:50:31.540954 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.virt.hardware [None req-aeace717-260c-423a-aa70-f533f10601c0 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Image pref 0:0:0 {{(pid=102212) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 14:50:31.540954 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.virt.hardware [None req-aeace717-260c-423a-aa70-f533f10601c0 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=102212) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 14:50:31.547421 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-aeace717-260c-423a-aa70-f533f10601c0 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:31.547980 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-aeace717-260c-423a-aa70-f533f10601c0 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:31.549012 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-aeace717-260c-423a-aa70-f533f10601c0 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:31.549459 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-aeace717-260c-423a-aa70-f533f10601c0 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:31.570881 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.quota [None req-aeace717-260c-423a-aa70-f533f10601c0 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Getting quotas for project 0301badcd92e4cc483246a0fa4949060. Resources: {'cores', 'ram', 'instances'} {{(pid=102212) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 12 14:50:31.575014 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.quota [None req-aeace717-260c-423a-aa70-f533f10601c0 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Getting quotas for user ccce5e3f8320498ea48fa16c7d811ee1 and project 0301badcd92e4cc483246a0fa4949060. Resources: {'cores', 'ram', 'instances'} {{(pid=102212) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 12 14:50:31.585533 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-aeace717-260c-423a-aa70-f533f10601c0 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Going to run 1 instances... {{(pid=102212) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 12 14:50:31.587908 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-aeace717-260c-423a-aa70-f533f10601c0 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 944e4e2e-d09f-4dd7-ac42-b037b09dc7c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a4587ab2-5f51-46a3-a023-0e6778ccaaa1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=102212) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} May 12 14:50:31.595720 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-4c2419c2-4378-44c6-aadd-41751fb089ac tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a641a08648b454780081ecc2e291066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a8451272cc41ebaf1598ed940bf09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:31.610218 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-4c2419c2-4378-44c6-aadd-41751fb089ac tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/84ccb759-1bc2-4810-8e46-e34c0c29a0d5" status: 200 len: 1366 microversion: 2.1 time: 0.259144 May 12 14:50:31.610218 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 145/285] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:31 2022] GET /compute/v2.1/servers/84ccb759-1bc2-4810-8e46-e34c0c29a0d5 => generated 1366 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:50:31.734594 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-aeace717-260c-423a-aa70-f533f10601c0 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.992896 May 12 14:50:31.735389 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 141/286] 10.222.0.49 () {60 vars in 1146 bytes} [Thu May 12 14:50:30 2022] POST /compute/v2.1/servers => generated 408 bytes in 994 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 14:50:31.746031 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-1ed1956f-a9c4-409a-8b2a-941dfb442259 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:31.746652 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-1ed1956f-a9c4-409a-8b2a-941dfb442259 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 944e4e2e-d09f-4dd7-ac42-b037b09dc7c3] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:31.761186 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-69beb927-032b-45cf-9fc4-a6b33202c6b1 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:31.772166 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-69beb927-032b-45cf-9fc4-a6b33202c6b1 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 3062e66d-4c2a-4212-b186-ecafec6bde2e] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:31.788316 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-69beb927-032b-45cf-9fc4-a6b33202c6b1 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:31.788765 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-69beb927-032b-45cf-9fc4-a6b33202c6b1 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:31.790071 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-69beb927-032b-45cf-9fc4-a6b33202c6b1 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:31.790506 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-69beb927-032b-45cf-9fc4-a6b33202c6b1 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:31.828398 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-1ed1956f-a9c4-409a-8b2a-941dfb442259 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:31.837302 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-1ed1956f-a9c4-409a-8b2a-941dfb442259 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3" status: 200 len: 1244 microversion: 2.1 time: 0.095775 May 12 14:50:31.847149 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 146/287] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:31 2022] GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3 => generated 1244 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:50:32.041529 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-69beb927-032b-45cf-9fc4-a6b33202c6b1 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e128ca83d6448c9ab1fe7dcc5467d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a090a68e336b4562aca524a95f550e04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:32.050980 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-69beb927-032b-45cf-9fc4-a6b33202c6b1 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e" status: 200 len: 1725 microversion: 2.1 time: 0.293185 May 12 14:50:32.051411 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 142/288] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:31 2022] GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e => generated 1725 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:50:32.360475 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-c0d950db-fd66-43b6-b619-20c9a38909a6 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:32.361081 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-c0d950db-fd66-43b6-b619-20c9a38909a6 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] [instance: 68b3c2de-3257-4c79-ad68-f4fea7bfde20] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:32.371321 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-c0d950db-fd66-43b6-b619-20c9a38909a6 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:32.371771 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-c0d950db-fd66-43b6-b619-20c9a38909a6 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:32.372612 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-c0d950db-fd66-43b6-b619-20c9a38909a6 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:32.373069 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-c0d950db-fd66-43b6-b619-20c9a38909a6 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:32.487636 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-c0d950db-fd66-43b6-b619-20c9a38909a6 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e423a2656146a7a820f6be3af8d21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c93480a75ab462f9181629c60772257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:32.496486 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-c0d950db-fd66-43b6-b619-20c9a38909a6 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] 10.222.0.49 "GET /compute/v2.1/servers/68b3c2de-3257-4c79-ad68-f4fea7bfde20" status: 200 len: 1216 microversion: 2.1 time: 0.139906 May 12 14:50:32.497070 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 147/289] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:32 2022] GET /compute/v2.1/servers/68b3c2de-3257-4c79-ad68-f4fea7bfde20 => generated 1216 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:50:32.622561 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-c11db43f-adb5-45d6-aa49-cf7e7d235c7e tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:32.623142 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-c11db43f-adb5-45d6-aa49-cf7e7d235c7e tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 84ccb759-1bc2-4810-8e46-e34c0c29a0d5] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:32.636820 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-c11db43f-adb5-45d6-aa49-cf7e7d235c7e tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:32.638627 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-c11db43f-adb5-45d6-aa49-cf7e7d235c7e tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:32.638627 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-c11db43f-adb5-45d6-aa49-cf7e7d235c7e tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:32.638627 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-c11db43f-adb5-45d6-aa49-cf7e7d235c7e tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:32.845155 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-c11db43f-adb5-45d6-aa49-cf7e7d235c7e tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a641a08648b454780081ecc2e291066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a8451272cc41ebaf1598ed940bf09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:32.853644 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-c11db43f-adb5-45d6-aa49-cf7e7d235c7e tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/84ccb759-1bc2-4810-8e46-e34c0c29a0d5" status: 200 len: 1366 microversion: 2.1 time: 0.235880 May 12 14:50:32.854396 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 143/290] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:32 2022] GET /compute/v2.1/servers/84ccb759-1bc2-4810-8e46-e34c0c29a0d5 => generated 1366 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:50:32.855031 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-784023a6-25bf-4a27-b69c-d04465363a24 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:32.855830 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-784023a6-25bf-4a27-b69c-d04465363a24 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 944e4e2e-d09f-4dd7-ac42-b037b09dc7c3] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:32.863296 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-784023a6-25bf-4a27-b69c-d04465363a24 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:32.863752 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-784023a6-25bf-4a27-b69c-d04465363a24 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:32.864573 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-784023a6-25bf-4a27-b69c-d04465363a24 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:32.865010 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-784023a6-25bf-4a27-b69c-d04465363a24 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:32.981359 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-784023a6-25bf-4a27-b69c-d04465363a24 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:32.989422 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-784023a6-25bf-4a27-b69c-d04465363a24 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3" status: 200 len: 1248 microversion: 2.1 time: 0.139198 May 12 14:50:32.989989 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 148/291] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:32 2022] GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3 => generated 1248 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:50:33.068271 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-20a14358-c1f8-47e5-ad72-96b32aead587 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:33.068978 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-20a14358-c1f8-47e5-ad72-96b32aead587 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 3062e66d-4c2a-4212-b186-ecafec6bde2e] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:33.077296 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-20a14358-c1f8-47e5-ad72-96b32aead587 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:33.077932 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-20a14358-c1f8-47e5-ad72-96b32aead587 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:33.079110 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-20a14358-c1f8-47e5-ad72-96b32aead587 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:33.079640 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-20a14358-c1f8-47e5-ad72-96b32aead587 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:33.292406 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-20a14358-c1f8-47e5-ad72-96b32aead587 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e128ca83d6448c9ab1fe7dcc5467d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a090a68e336b4562aca524a95f550e04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:33.300953 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-20a14358-c1f8-47e5-ad72-96b32aead587 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e" status: 200 len: 1725 microversion: 2.1 time: 0.236434 May 12 14:50:33.304352 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 144/292] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:33 2022] GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e => generated 1725 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:50:33.513262 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-6c14a304-4f55-40fc-a8fb-f5cf677bad28 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:33.513898 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-6c14a304-4f55-40fc-a8fb-f5cf677bad28 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] [instance: 68b3c2de-3257-4c79-ad68-f4fea7bfde20] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:33.521016 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-6c14a304-4f55-40fc-a8fb-f5cf677bad28 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:33.521455 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-6c14a304-4f55-40fc-a8fb-f5cf677bad28 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:33.522208 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-6c14a304-4f55-40fc-a8fb-f5cf677bad28 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:33.522634 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-6c14a304-4f55-40fc-a8fb-f5cf677bad28 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:33.632652 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-6c14a304-4f55-40fc-a8fb-f5cf677bad28 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e423a2656146a7a820f6be3af8d21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c93480a75ab462f9181629c60772257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:33.641702 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-6c14a304-4f55-40fc-a8fb-f5cf677bad28 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] 10.222.0.49 "GET /compute/v2.1/servers/68b3c2de-3257-4c79-ad68-f4fea7bfde20" status: 200 len: 1208 microversion: 2.1 time: 0.131953 May 12 14:50:33.642273 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 149/293] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:33 2022] GET /compute/v2.1/servers/68b3c2de-3257-4c79-ad68-f4fea7bfde20 => generated 1208 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:50:33.871026 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-3add2941-aeb0-4210-94e0-b93561817140 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:33.871649 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-3add2941-aeb0-4210-94e0-b93561817140 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 84ccb759-1bc2-4810-8e46-e34c0c29a0d5] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:33.880277 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-3add2941-aeb0-4210-94e0-b93561817140 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:33.880721 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-3add2941-aeb0-4210-94e0-b93561817140 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:33.881545 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-3add2941-aeb0-4210-94e0-b93561817140 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:33.881979 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-3add2941-aeb0-4210-94e0-b93561817140 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:34.013274 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-02344bab-6a46-4253-8413-655781d8c765 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:34.014578 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-02344bab-6a46-4253-8413-655781d8c765 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 944e4e2e-d09f-4dd7-ac42-b037b09dc7c3] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:34.024106 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-02344bab-6a46-4253-8413-655781d8c765 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:34.029658 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-02344bab-6a46-4253-8413-655781d8c765 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:34.029658 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-02344bab-6a46-4253-8413-655781d8c765 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:34.029658 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-02344bab-6a46-4253-8413-655781d8c765 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:34.146414 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-02344bab-6a46-4253-8413-655781d8c765 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:34.176920 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-02344bab-6a46-4253-8413-655781d8c765 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3" status: 200 len: 1248 microversion: 2.1 time: 0.167807 May 12 14:50:34.177648 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 150/294] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:34 2022] GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3 => generated 1248 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:50:34.196393 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-3add2941-aeb0-4210-94e0-b93561817140 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a641a08648b454780081ecc2e291066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a8451272cc41ebaf1598ed940bf09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:34.201951 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-3add2941-aeb0-4210-94e0-b93561817140 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/84ccb759-1bc2-4810-8e46-e34c0c29a0d5" status: 200 len: 1366 microversion: 2.1 time: 0.335228 May 12 14:50:34.202582 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 145/295] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:33 2022] GET /compute/v2.1/servers/84ccb759-1bc2-4810-8e46-e34c0c29a0d5 => generated 1366 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:50:34.324353 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-75378190-4618-458b-b5e9-a0f0fcf660c8 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:34.324969 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-75378190-4618-458b-b5e9-a0f0fcf660c8 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 3062e66d-4c2a-4212-b186-ecafec6bde2e] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:34.332306 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-75378190-4618-458b-b5e9-a0f0fcf660c8 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:34.332758 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-75378190-4618-458b-b5e9-a0f0fcf660c8 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:34.333530 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-75378190-4618-458b-b5e9-a0f0fcf660c8 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:34.333962 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-75378190-4618-458b-b5e9-a0f0fcf660c8 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:34.532801 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-75378190-4618-458b-b5e9-a0f0fcf660c8 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e128ca83d6448c9ab1fe7dcc5467d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a090a68e336b4562aca524a95f550e04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:34.541865 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-75378190-4618-458b-b5e9-a0f0fcf660c8 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e" status: 200 len: 1725 microversion: 2.1 time: 0.224988 May 12 14:50:34.542430 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 151/296] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:34 2022] GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e => generated 1725 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:50:34.659050 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-fec6ff8b-3b1f-49d8-a2f5-fd44bbf67367 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:34.659664 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-fec6ff8b-3b1f-49d8-a2f5-fd44bbf67367 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] [instance: 68b3c2de-3257-4c79-ad68-f4fea7bfde20] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:34.667787 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-fec6ff8b-3b1f-49d8-a2f5-fd44bbf67367 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:34.668235 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-fec6ff8b-3b1f-49d8-a2f5-fd44bbf67367 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:34.669034 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-fec6ff8b-3b1f-49d8-a2f5-fd44bbf67367 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:34.669466 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-fec6ff8b-3b1f-49d8-a2f5-fd44bbf67367 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:34.782771 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-fec6ff8b-3b1f-49d8-a2f5-fd44bbf67367 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e423a2656146a7a820f6be3af8d21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c93480a75ab462f9181629c60772257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:34.791256 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-fec6ff8b-3b1f-49d8-a2f5-fd44bbf67367 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] 10.222.0.49 "GET /compute/v2.1/servers/68b3c2de-3257-4c79-ad68-f4fea7bfde20" status: 200 len: 1208 microversion: 2.1 time: 0.136278 May 12 14:50:34.791814 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 146/297] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:34 2022] GET /compute/v2.1/servers/68b3c2de-3257-4c79-ad68-f4fea7bfde20 => generated 1208 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:50:35.193348 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-0928acaf-d9ce-4ce7-8207-5df3a61292ae tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:35.194037 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-0928acaf-d9ce-4ce7-8207-5df3a61292ae tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 944e4e2e-d09f-4dd7-ac42-b037b09dc7c3] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:35.201255 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-0928acaf-d9ce-4ce7-8207-5df3a61292ae tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:35.201870 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-0928acaf-d9ce-4ce7-8207-5df3a61292ae tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:35.202615 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-0928acaf-d9ce-4ce7-8207-5df3a61292ae tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:35.203150 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-0928acaf-d9ce-4ce7-8207-5df3a61292ae tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:35.219869 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-91b80f8d-6d1e-4291-9aea-3706f55594e0 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:35.220485 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-91b80f8d-6d1e-4291-9aea-3706f55594e0 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 84ccb759-1bc2-4810-8e46-e34c0c29a0d5] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:35.228585 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-91b80f8d-6d1e-4291-9aea-3706f55594e0 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:35.229028 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-91b80f8d-6d1e-4291-9aea-3706f55594e0 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:35.229794 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-91b80f8d-6d1e-4291-9aea-3706f55594e0 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:35.230216 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-91b80f8d-6d1e-4291-9aea-3706f55594e0 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:35.317491 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-0928acaf-d9ce-4ce7-8207-5df3a61292ae tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:35.325629 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-0928acaf-d9ce-4ce7-8207-5df3a61292ae tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3" status: 200 len: 1248 microversion: 2.1 time: 0.136014 May 12 14:50:35.326184 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 152/298] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:35 2022] GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3 => generated 1248 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:50:35.428516 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-91b80f8d-6d1e-4291-9aea-3706f55594e0 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a641a08648b454780081ecc2e291066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a8451272cc41ebaf1598ed940bf09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:35.437180 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-91b80f8d-6d1e-4291-9aea-3706f55594e0 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/84ccb759-1bc2-4810-8e46-e34c0c29a0d5" status: 200 len: 1366 microversion: 2.1 time: 0.220859 May 12 14:50:35.437669 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 147/299] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:35 2022] GET /compute/v2.1/servers/84ccb759-1bc2-4810-8e46-e34c0c29a0d5 => generated 1366 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:50:35.560158 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-5acd22d6-0751-480a-8614-f954bf5a439b tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:35.560892 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-5acd22d6-0751-480a-8614-f954bf5a439b tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 3062e66d-4c2a-4212-b186-ecafec6bde2e] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:35.568582 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-5acd22d6-0751-480a-8614-f954bf5a439b tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:35.569108 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-5acd22d6-0751-480a-8614-f954bf5a439b tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:35.569992 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-5acd22d6-0751-480a-8614-f954bf5a439b tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:35.570529 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-5acd22d6-0751-480a-8614-f954bf5a439b tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:35.777294 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-5acd22d6-0751-480a-8614-f954bf5a439b tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e128ca83d6448c9ab1fe7dcc5467d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a090a68e336b4562aca524a95f550e04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:35.787882 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-5acd22d6-0751-480a-8614-f954bf5a439b tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e" status: 200 len: 1725 microversion: 2.1 time: 0.232524 May 12 14:50:35.788458 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 153/300] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:35 2022] GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e => generated 1725 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:50:35.807465 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-448f2e23-9df3-4245-af47-f049126f226a tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:35.814091 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-448f2e23-9df3-4245-af47-f049126f226a tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] [instance: 68b3c2de-3257-4c79-ad68-f4fea7bfde20] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:35.815888 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-448f2e23-9df3-4245-af47-f049126f226a tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:35.816340 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-448f2e23-9df3-4245-af47-f049126f226a tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:35.817146 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-448f2e23-9df3-4245-af47-f049126f226a tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:35.817629 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-448f2e23-9df3-4245-af47-f049126f226a tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:35.936276 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-448f2e23-9df3-4245-af47-f049126f226a tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e423a2656146a7a820f6be3af8d21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c93480a75ab462f9181629c60772257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:35.944329 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-448f2e23-9df3-4245-af47-f049126f226a tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] 10.222.0.49 "GET /compute/v2.1/servers/68b3c2de-3257-4c79-ad68-f4fea7bfde20" status: 200 len: 1264 microversion: 2.1 time: 0.141148 May 12 14:50:35.946244 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 148/301] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:35 2022] GET /compute/v2.1/servers/68b3c2de-3257-4c79-ad68-f4fea7bfde20 => generated 1264 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:50:36.342435 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-13220276-f651-4946-a184-dface4637cd3 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:36.343076 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-13220276-f651-4946-a184-dface4637cd3 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 944e4e2e-d09f-4dd7-ac42-b037b09dc7c3] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:36.350235 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-13220276-f651-4946-a184-dface4637cd3 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:36.350689 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-13220276-f651-4946-a184-dface4637cd3 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:36.351491 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-13220276-f651-4946-a184-dface4637cd3 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:36.352428 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-13220276-f651-4946-a184-dface4637cd3 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:36.453332 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-a8e6013b-f0dc-47e8-b349-a1f7dc25f6fa tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:36.454905 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-a8e6013b-f0dc-47e8-b349-a1f7dc25f6fa tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 84ccb759-1bc2-4810-8e46-e34c0c29a0d5] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:36.468540 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-a8e6013b-f0dc-47e8-b349-a1f7dc25f6fa tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:36.469093 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-a8e6013b-f0dc-47e8-b349-a1f7dc25f6fa tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:36.469993 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-a8e6013b-f0dc-47e8-b349-a1f7dc25f6fa tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:36.470445 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-a8e6013b-f0dc-47e8-b349-a1f7dc25f6fa tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:36.475003 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-13220276-f651-4946-a184-dface4637cd3 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:36.483888 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-13220276-f651-4946-a184-dface4637cd3 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3" status: 200 len: 1240 microversion: 2.1 time: 0.145157 May 12 14:50:36.485180 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 154/302] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:36 2022] GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3 => generated 1240 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:50:36.804327 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-9a9c461b-6fc6-4d89-977d-e3be6ffe63de tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:36.805531 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-9a9c461b-6fc6-4d89-977d-e3be6ffe63de tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 3062e66d-4c2a-4212-b186-ecafec6bde2e] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:36.812791 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-9a9c461b-6fc6-4d89-977d-e3be6ffe63de tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:36.817088 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-9a9c461b-6fc6-4d89-977d-e3be6ffe63de tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:36.817088 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-9a9c461b-6fc6-4d89-977d-e3be6ffe63de tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:36.817088 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-9a9c461b-6fc6-4d89-977d-e3be6ffe63de tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:36.913781 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-a8e6013b-f0dc-47e8-b349-a1f7dc25f6fa tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a641a08648b454780081ecc2e291066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a8451272cc41ebaf1598ed940bf09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:36.932393 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-a8e6013b-f0dc-47e8-b349-a1f7dc25f6fa tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/84ccb759-1bc2-4810-8e46-e34c0c29a0d5" status: 200 len: 1366 microversion: 2.1 time: 0.482586 May 12 14:50:36.932985 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 149/303] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:36 2022] GET /compute/v2.1/servers/84ccb759-1bc2-4810-8e46-e34c0c29a0d5 => generated 1366 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:50:36.963293 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-697f0845-81c5-48e6-87b7-2570749ee6c2 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:36.963930 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-697f0845-81c5-48e6-87b7-2570749ee6c2 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] [instance: 68b3c2de-3257-4c79-ad68-f4fea7bfde20] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:36.972860 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-697f0845-81c5-48e6-87b7-2570749ee6c2 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:36.973317 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-697f0845-81c5-48e6-87b7-2570749ee6c2 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:36.974108 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-697f0845-81c5-48e6-87b7-2570749ee6c2 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:36.974703 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-697f0845-81c5-48e6-87b7-2570749ee6c2 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:37.092725 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-9a9c461b-6fc6-4d89-977d-e3be6ffe63de tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e128ca83d6448c9ab1fe7dcc5467d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a090a68e336b4562aca524a95f550e04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:37.102286 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-9a9c461b-6fc6-4d89-977d-e3be6ffe63de tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e" status: 200 len: 1725 microversion: 2.1 time: 0.301574 May 12 14:50:37.106225 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 155/304] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:36 2022] GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e => generated 1725 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:50:37.110121 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-697f0845-81c5-48e6-87b7-2570749ee6c2 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e423a2656146a7a820f6be3af8d21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c93480a75ab462f9181629c60772257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:37.120557 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-697f0845-81c5-48e6-87b7-2570749ee6c2 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] 10.222.0.49 "GET /compute/v2.1/servers/68b3c2de-3257-4c79-ad68-f4fea7bfde20" status: 200 len: 1282 microversion: 2.1 time: 0.162690 May 12 14:50:37.121556 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 150/305] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:36 2022] GET /compute/v2.1/servers/68b3c2de-3257-4c79-ad68-f4fea7bfde20 => generated 1282 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:50:37.501440 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-9ab18de3-bee6-4b58-a1b8-2fb09969b51f tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:37.502060 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-9ab18de3-bee6-4b58-a1b8-2fb09969b51f tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 944e4e2e-d09f-4dd7-ac42-b037b09dc7c3] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:37.509771 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-9ab18de3-bee6-4b58-a1b8-2fb09969b51f tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:37.510226 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-9ab18de3-bee6-4b58-a1b8-2fb09969b51f tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:37.511039 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-9ab18de3-bee6-4b58-a1b8-2fb09969b51f tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:37.511477 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-9ab18de3-bee6-4b58-a1b8-2fb09969b51f tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:37.622223 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-9ab18de3-bee6-4b58-a1b8-2fb09969b51f tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:37.630674 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-9ab18de3-bee6-4b58-a1b8-2fb09969b51f tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3" status: 200 len: 1304 microversion: 2.1 time: 0.132953 May 12 14:50:37.631573 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 156/306] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:37 2022] GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3 => generated 1304 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:50:37.949623 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-abc646e8-d25c-45ed-9e11-e1ca66c184a5 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:37.950260 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-abc646e8-d25c-45ed-9e11-e1ca66c184a5 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 84ccb759-1bc2-4810-8e46-e34c0c29a0d5] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:37.957727 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-abc646e8-d25c-45ed-9e11-e1ca66c184a5 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:37.958180 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-abc646e8-d25c-45ed-9e11-e1ca66c184a5 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:37.958993 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-abc646e8-d25c-45ed-9e11-e1ca66c184a5 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:37.959432 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-abc646e8-d25c-45ed-9e11-e1ca66c184a5 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:38.120185 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-56c8b0eb-2315-4b8f-8ac4-d66d3cb31c97 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:38.120842 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-56c8b0eb-2315-4b8f-8ac4-d66d3cb31c97 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 3062e66d-4c2a-4212-b186-ecafec6bde2e] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:38.128559 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-56c8b0eb-2315-4b8f-8ac4-d66d3cb31c97 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:38.129007 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-56c8b0eb-2315-4b8f-8ac4-d66d3cb31c97 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:38.129798 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-56c8b0eb-2315-4b8f-8ac4-d66d3cb31c97 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:38.130282 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-56c8b0eb-2315-4b8f-8ac4-d66d3cb31c97 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:38.298397 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-abc646e8-d25c-45ed-9e11-e1ca66c184a5 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a641a08648b454780081ecc2e291066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a8451272cc41ebaf1598ed940bf09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:38.307207 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-abc646e8-d25c-45ed-9e11-e1ca66c184a5 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/84ccb759-1bc2-4810-8e46-e34c0c29a0d5" status: 200 len: 1366 microversion: 2.1 time: 0.361720 May 12 14:50:38.307853 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 151/307] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:37 2022] GET /compute/v2.1/servers/84ccb759-1bc2-4810-8e46-e34c0c29a0d5 => generated 1366 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:50:38.316483 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-c4e12759-35f1-42b0-ac76-472fb83b4f93 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:38.316483 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-c4e12759-35f1-42b0-ac76-472fb83b4f93 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] [instance: 68b3c2de-3257-4c79-ad68-f4fea7bfde20] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:38.320531 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-c4e12759-35f1-42b0-ac76-472fb83b4f93 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:38.321044 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-c4e12759-35f1-42b0-ac76-472fb83b4f93 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:38.321890 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-c4e12759-35f1-42b0-ac76-472fb83b4f93 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:38.322395 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-c4e12759-35f1-42b0-ac76-472fb83b4f93 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:38.332501 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-56c8b0eb-2315-4b8f-8ac4-d66d3cb31c97 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e128ca83d6448c9ab1fe7dcc5467d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a090a68e336b4562aca524a95f550e04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:38.341187 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-56c8b0eb-2315-4b8f-8ac4-d66d3cb31c97 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e" status: 200 len: 1725 microversion: 2.1 time: 0.225420 May 12 14:50:38.342035 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 157/308] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:38 2022] GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e => generated 1725 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:50:38.581758 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-c4e12759-35f1-42b0-ac76-472fb83b4f93 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e423a2656146a7a820f6be3af8d21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c93480a75ab462f9181629c60772257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:38.590214 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-c4e12759-35f1-42b0-ac76-472fb83b4f93 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] 10.222.0.49 "GET /compute/v2.1/servers/68b3c2de-3257-4c79-ad68-f4fea7bfde20" status: 200 len: 1312 microversion: 2.1 time: 0.281356 May 12 14:50:38.590752 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 152/309] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:38 2022] GET /compute/v2.1/servers/68b3c2de-3257-4c79-ad68-f4fea7bfde20 => generated 1312 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:50:38.647583 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-a807bf07-2d2c-4804-879e-d92b24869a11 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:38.648196 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-a807bf07-2d2c-4804-879e-d92b24869a11 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 944e4e2e-d09f-4dd7-ac42-b037b09dc7c3] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:38.656297 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-a807bf07-2d2c-4804-879e-d92b24869a11 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:38.656744 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-a807bf07-2d2c-4804-879e-d92b24869a11 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:38.657504 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-a807bf07-2d2c-4804-879e-d92b24869a11 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:38.657940 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-a807bf07-2d2c-4804-879e-d92b24869a11 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:38.776021 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-a807bf07-2d2c-4804-879e-d92b24869a11 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:38.784314 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-a807bf07-2d2c-4804-879e-d92b24869a11 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3" status: 200 len: 1304 microversion: 2.1 time: 0.140402 May 12 14:50:38.784885 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 158/310] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:38 2022] GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3 => generated 1304 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:50:39.324113 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-2183151b-adbe-498e-905b-10b845014506 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:39.324813 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-2183151b-adbe-498e-905b-10b845014506 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 84ccb759-1bc2-4810-8e46-e34c0c29a0d5] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:39.332010 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-2183151b-adbe-498e-905b-10b845014506 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:39.332490 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-2183151b-adbe-498e-905b-10b845014506 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:39.333269 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-2183151b-adbe-498e-905b-10b845014506 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:39.333691 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-2183151b-adbe-498e-905b-10b845014506 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:39.357938 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-21aacdbb-8d4f-4bfa-8541-94967764c2ae tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:39.358832 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-21aacdbb-8d4f-4bfa-8541-94967764c2ae tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 3062e66d-4c2a-4212-b186-ecafec6bde2e] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:39.366455 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-21aacdbb-8d4f-4bfa-8541-94967764c2ae tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:39.367038 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-21aacdbb-8d4f-4bfa-8541-94967764c2ae tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:39.368383 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-21aacdbb-8d4f-4bfa-8541-94967764c2ae tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:39.369088 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-21aacdbb-8d4f-4bfa-8541-94967764c2ae tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:39.537467 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-2183151b-adbe-498e-905b-10b845014506 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a641a08648b454780081ecc2e291066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a8451272cc41ebaf1598ed940bf09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:39.546227 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-2183151b-adbe-498e-905b-10b845014506 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/84ccb759-1bc2-4810-8e46-e34c0c29a0d5" status: 200 len: 1366 microversion: 2.1 time: 0.225971 May 12 14:50:39.546775 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 153/311] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:39 2022] GET /compute/v2.1/servers/84ccb759-1bc2-4810-8e46-e34c0c29a0d5 => generated 1366 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:50:39.551116 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [req-e11be798-266d-4ffa-bb3f-02905715ab4f req-128794f5-6edb-496f-918e-29dd6b657c4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84ccb759-1bc2-4810-8e46-e34c0c29a0d5", "name": "network-vif-plugged", "status": "completed", "tag": "941ee56d-a8a8-4017-bba8-1c38eaac468b"}]} {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:50:39.552678 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:50:39.552678 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: warnings.warn(msg) May 12 14:50:39.560677 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [req-e11be798-266d-4ffa-bb3f-02905715ab4f req-128794f5-6edb-496f-918e-29dd6b657c4d service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:39.561118 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [req-e11be798-266d-4ffa-bb3f-02905715ab4f req-128794f5-6edb-496f-918e-29dd6b657c4d service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:39.574456 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-21aacdbb-8d4f-4bfa-8541-94967764c2ae tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e128ca83d6448c9ab1fe7dcc5467d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a090a68e336b4562aca524a95f550e04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:39.577605 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.compute.server_external_events [req-e11be798-266d-4ffa-bb3f-02905715ab4f req-128794f5-6edb-496f-918e-29dd6b657c4d service nova] Creating event network-vif-plugged:941ee56d-a8a8-4017-bba8-1c38eaac468b for instance 84ccb759-1bc2-4810-8e46-e34c0c29a0d5 on hv-cinder-83118 May 12 14:50:39.582390 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [req-e11be798-266d-4ffa-bb3f-02905715ab4f req-128794f5-6edb-496f-918e-29dd6b657c4d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034486 May 12 14:50:39.589045 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 154/312] 10.222.0.49 () {64 vars in 1317 bytes} [Thu May 12 14:50:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:50:39.589435 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-21aacdbb-8d4f-4bfa-8541-94967764c2ae tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e" status: 200 len: 1725 microversion: 2.1 time: 0.229404 May 12 14:50:39.589435 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 159/313] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:39 2022] GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e => generated 1725 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:50:39.607666 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-1f6ea034-a9c6-4c37-9a28-a7c15b156cdc tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:39.608364 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-1f6ea034-a9c6-4c37-9a28-a7c15b156cdc tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] [instance: 68b3c2de-3257-4c79-ad68-f4fea7bfde20] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:39.615834 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-1f6ea034-a9c6-4c37-9a28-a7c15b156cdc tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:39.616285 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-1f6ea034-a9c6-4c37-9a28-a7c15b156cdc tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:39.617061 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-1f6ea034-a9c6-4c37-9a28-a7c15b156cdc tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:39.618002 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-1f6ea034-a9c6-4c37-9a28-a7c15b156cdc tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:39.800865 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-2b981b80-6ba7-4760-939a-b53c3a378b25 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:39.801564 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-2b981b80-6ba7-4760-939a-b53c3a378b25 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 944e4e2e-d09f-4dd7-ac42-b037b09dc7c3] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:39.809393 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-2b981b80-6ba7-4760-939a-b53c3a378b25 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:39.809919 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-2b981b80-6ba7-4760-939a-b53c3a378b25 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:39.810755 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-2b981b80-6ba7-4760-939a-b53c3a378b25 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:39.811275 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-2b981b80-6ba7-4760-939a-b53c3a378b25 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:39.814888 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-1f6ea034-a9c6-4c37-9a28-a7c15b156cdc tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e423a2656146a7a820f6be3af8d21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c93480a75ab462f9181629c60772257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:39.826671 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-1f6ea034-a9c6-4c37-9a28-a7c15b156cdc tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] 10.222.0.49 "GET /compute/v2.1/servers/68b3c2de-3257-4c79-ad68-f4fea7bfde20" status: 200 len: 1312 microversion: 2.1 time: 0.222159 May 12 14:50:39.835792 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 155/314] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:39 2022] GET /compute/v2.1/servers/68b3c2de-3257-4c79-ad68-f4fea7bfde20 => generated 1312 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:50:39.928213 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-2b981b80-6ba7-4760-939a-b53c3a378b25 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:39.936572 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-2b981b80-6ba7-4760-939a-b53c3a378b25 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3" status: 200 len: 1304 microversion: 2.1 time: 0.139441 May 12 14:50:39.937155 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 160/315] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:39 2022] GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3 => generated 1304 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:50:40.563179 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-5f9b454e-d4e2-44f4-adc3-9b225e9c2b5e tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:40.563844 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-5f9b454e-d4e2-44f4-adc3-9b225e9c2b5e tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 84ccb759-1bc2-4810-8e46-e34c0c29a0d5] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:40.571528 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-5f9b454e-d4e2-44f4-adc3-9b225e9c2b5e tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:40.571980 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-5f9b454e-d4e2-44f4-adc3-9b225e9c2b5e tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:40.575513 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-5f9b454e-d4e2-44f4-adc3-9b225e9c2b5e tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:40.576211 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-5f9b454e-d4e2-44f4-adc3-9b225e9c2b5e tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:40.601280 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-fa422691-0475-4123-9b04-577cbebd0c4d tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:40.602991 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-fa422691-0475-4123-9b04-577cbebd0c4d tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 3062e66d-4c2a-4212-b186-ecafec6bde2e] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:40.614745 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-fa422691-0475-4123-9b04-577cbebd0c4d tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:40.615219 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-fa422691-0475-4123-9b04-577cbebd0c4d tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:40.615999 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-fa422691-0475-4123-9b04-577cbebd0c4d tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:40.616467 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-fa422691-0475-4123-9b04-577cbebd0c4d tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:40.844206 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-fa422691-0475-4123-9b04-577cbebd0c4d tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e128ca83d6448c9ab1fe7dcc5467d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a090a68e336b4562aca524a95f550e04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:40.853870 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-fa422691-0475-4123-9b04-577cbebd0c4d tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e" status: 200 len: 1725 microversion: 2.1 time: 0.256524 May 12 14:50:40.863594 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 161/316] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:40 2022] GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e => generated 1725 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:50:40.863594 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-c3e1b980-df81-46a7-b216-6197f3d8499f tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:40.863594 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-c3e1b980-df81-46a7-b216-6197f3d8499f tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] [instance: 68b3c2de-3257-4c79-ad68-f4fea7bfde20] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:40.867174 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-c3e1b980-df81-46a7-b216-6197f3d8499f tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:40.868143 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-c3e1b980-df81-46a7-b216-6197f3d8499f tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:40.868934 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-c3e1b980-df81-46a7-b216-6197f3d8499f tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:40.869370 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-c3e1b980-df81-46a7-b216-6197f3d8499f tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:41.084188 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-c3e1b980-df81-46a7-b216-6197f3d8499f tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e423a2656146a7a820f6be3af8d21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c93480a75ab462f9181629c60772257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:41.093121 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-c3e1b980-df81-46a7-b216-6197f3d8499f tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] 10.222.0.49 "GET /compute/v2.1/servers/68b3c2de-3257-4c79-ad68-f4fea7bfde20" status: 200 len: 1312 microversion: 2.1 time: 0.237396 May 12 14:50:41.094246 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 162/317] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:40 2022] GET /compute/v2.1/servers/68b3c2de-3257-4c79-ad68-f4fea7bfde20 => generated 1312 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:50:41.098662 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-4e7e5b10-ed0d-4e47-ae5c-3ac5751a4f6f tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:41.099335 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-4e7e5b10-ed0d-4e47-ae5c-3ac5751a4f6f tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 944e4e2e-d09f-4dd7-ac42-b037b09dc7c3] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:41.112501 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-4e7e5b10-ed0d-4e47-ae5c-3ac5751a4f6f tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:41.113014 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-4e7e5b10-ed0d-4e47-ae5c-3ac5751a4f6f tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:41.113827 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-4e7e5b10-ed0d-4e47-ae5c-3ac5751a4f6f tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:41.114266 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-4e7e5b10-ed0d-4e47-ae5c-3ac5751a4f6f tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:41.190513 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-5f9b454e-d4e2-44f4-adc3-9b225e9c2b5e tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a641a08648b454780081ecc2e291066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a8451272cc41ebaf1598ed940bf09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:41.199853 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-5f9b454e-d4e2-44f4-adc3-9b225e9c2b5e tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/84ccb759-1bc2-4810-8e46-e34c0c29a0d5" status: 200 len: 1366 microversion: 2.1 time: 0.639912 May 12 14:50:41.203503 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 156/318] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:40 2022] GET /compute/v2.1/servers/84ccb759-1bc2-4810-8e46-e34c0c29a0d5 => generated 1366 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:50:41.263945 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-4e7e5b10-ed0d-4e47-ae5c-3ac5751a4f6f tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:41.272729 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-4e7e5b10-ed0d-4e47-ae5c-3ac5751a4f6f tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3" status: 200 len: 1302 microversion: 2.1 time: 0.177426 May 12 14:50:41.273656 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 163/319] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:41 2022] GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3 => generated 1302 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:50:41.871802 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-08b58e9a-e73f-4084-a914-73c2e8f77d01 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:41.872346 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-08b58e9a-e73f-4084-a914-73c2e8f77d01 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 3062e66d-4c2a-4212-b186-ecafec6bde2e] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:41.879664 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-08b58e9a-e73f-4084-a914-73c2e8f77d01 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:41.880108 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-08b58e9a-e73f-4084-a914-73c2e8f77d01 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:41.880864 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-08b58e9a-e73f-4084-a914-73c2e8f77d01 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:41.881286 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-08b58e9a-e73f-4084-a914-73c2e8f77d01 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:42.109933 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-02f9da9f-65be-4eb3-af73-ae5eb131b5da tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:42.110635 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-02f9da9f-65be-4eb3-af73-ae5eb131b5da tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] [instance: 68b3c2de-3257-4c79-ad68-f4fea7bfde20] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:42.119437 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-02f9da9f-65be-4eb3-af73-ae5eb131b5da tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:42.119437 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-02f9da9f-65be-4eb3-af73-ae5eb131b5da tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:42.120337 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-02f9da9f-65be-4eb3-af73-ae5eb131b5da tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:42.120930 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-02f9da9f-65be-4eb3-af73-ae5eb131b5da tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:42.314071 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-08b58e9a-e73f-4084-a914-73c2e8f77d01 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e128ca83d6448c9ab1fe7dcc5467d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a090a68e336b4562aca524a95f550e04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:42.322678 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-08b58e9a-e73f-4084-a914-73c2e8f77d01 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e" status: 200 len: 1725 microversion: 2.1 time: 0.455247 May 12 14:50:42.323273 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 157/320] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:41 2022] GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e => generated 1725 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:50:42.332499 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-6bfd7907-a310-41c2-ab61-e0311fabe868 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:42.332499 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-6bfd7907-a310-41c2-ab61-e0311fabe868 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 84ccb759-1bc2-4810-8e46-e34c0c29a0d5] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:42.335161 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-6bfd7907-a310-41c2-ab61-e0311fabe868 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:42.335600 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-6bfd7907-a310-41c2-ab61-e0311fabe868 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:42.335810 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-02f9da9f-65be-4eb3-af73-ae5eb131b5da tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e423a2656146a7a820f6be3af8d21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c93480a75ab462f9181629c60772257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:42.336374 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-6bfd7907-a310-41c2-ab61-e0311fabe868 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:42.336808 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-6bfd7907-a310-41c2-ab61-e0311fabe868 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:42.344238 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-02f9da9f-65be-4eb3-af73-ae5eb131b5da tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] 10.222.0.49 "GET /compute/v2.1/servers/68b3c2de-3257-4c79-ad68-f4fea7bfde20" status: 200 len: 1312 microversion: 2.1 time: 0.238002 May 12 14:50:42.345038 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 164/321] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:42 2022] GET /compute/v2.1/servers/68b3c2de-3257-4c79-ad68-f4fea7bfde20 => generated 1312 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:50:42.358267 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-06571ef2-b1cf-447f-aa98-c7b4cce4d8dc tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:42.358936 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-06571ef2-b1cf-447f-aa98-c7b4cce4d8dc tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 944e4e2e-d09f-4dd7-ac42-b037b09dc7c3] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:42.366415 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-06571ef2-b1cf-447f-aa98-c7b4cce4d8dc tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:42.366887 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-06571ef2-b1cf-447f-aa98-c7b4cce4d8dc tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:42.368263 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-06571ef2-b1cf-447f-aa98-c7b4cce4d8dc tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:42.368694 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-06571ef2-b1cf-447f-aa98-c7b4cce4d8dc tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:42.630402 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-06571ef2-b1cf-447f-aa98-c7b4cce4d8dc tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:42.639846 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-06571ef2-b1cf-447f-aa98-c7b4cce4d8dc tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3" status: 200 len: 1369 microversion: 2.1 time: 0.284989 May 12 14:50:42.641505 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 165/322] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:42 2022] GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3 => generated 1369 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:50:42.645364 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [req-2806dbb0-ddd9-4a96-a8e0-820529730c22 req-cb86be7f-5bad-4e52-93dd-b452f32ffb09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68b3c2de-3257-4c79-ad68-f4fea7bfde20", "tag": "6e8c413a-feeb-438c-8a0b-999e6b370582"}]} {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:50:42.647092 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:50:42.647092 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: warnings.warn(msg) May 12 14:50:42.656291 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [req-2806dbb0-ddd9-4a96-a8e0-820529730c22 req-cb86be7f-5bad-4e52-93dd-b452f32ffb09 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:42.656837 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [req-2806dbb0-ddd9-4a96-a8e0-820529730c22 req-cb86be7f-5bad-4e52-93dd-b452f32ffb09 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:42.676749 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.compute.server_external_events [req-2806dbb0-ddd9-4a96-a8e0-820529730c22 req-cb86be7f-5bad-4e52-93dd-b452f32ffb09 service nova] Creating event network-changed:6e8c413a-feeb-438c-8a0b-999e6b370582 for instance 68b3c2de-3257-4c79-ad68-f4fea7bfde20 on hv-cinder-83118 May 12 14:50:42.684334 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [req-2806dbb0-ddd9-4a96-a8e0-820529730c22 req-cb86be7f-5bad-4e52-93dd-b452f32ffb09 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042543 May 12 14:50:42.687200 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 166/323] 10.222.0.49 () {64 vars in 1317 bytes} [Thu May 12 14:50:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:50:42.729028 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-6bfd7907-a310-41c2-ab61-e0311fabe868 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a641a08648b454780081ecc2e291066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a8451272cc41ebaf1598ed940bf09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:42.737027 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-6bfd7907-a310-41c2-ab61-e0311fabe868 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/84ccb759-1bc2-4810-8e46-e34c0c29a0d5" status: 200 len: 1366 microversion: 2.1 time: 0.412812 May 12 14:50:42.737580 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 158/324] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:42 2022] GET /compute/v2.1/servers/84ccb759-1bc2-4810-8e46-e34c0c29a0d5 => generated 1366 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:50:43.339991 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-11cc34f9-01d4-4b4b-8bf0-376d988c1864 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:43.340713 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-11cc34f9-01d4-4b4b-8bf0-376d988c1864 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 3062e66d-4c2a-4212-b186-ecafec6bde2e] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:43.348187 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-11cc34f9-01d4-4b4b-8bf0-376d988c1864 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:43.348631 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-11cc34f9-01d4-4b4b-8bf0-376d988c1864 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:43.349389 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-11cc34f9-01d4-4b4b-8bf0-376d988c1864 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:43.349822 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-11cc34f9-01d4-4b4b-8bf0-376d988c1864 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:43.361029 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-a8887096-8f62-4c9c-974c-e0a62a73a87d tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:43.361637 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-a8887096-8f62-4c9c-974c-e0a62a73a87d tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] [instance: 68b3c2de-3257-4c79-ad68-f4fea7bfde20] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:43.369412 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-a8887096-8f62-4c9c-974c-e0a62a73a87d tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:43.369865 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-a8887096-8f62-4c9c-974c-e0a62a73a87d tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:43.370631 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-a8887096-8f62-4c9c-974c-e0a62a73a87d tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:43.371163 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-a8887096-8f62-4c9c-974c-e0a62a73a87d tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:43.553307 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-11cc34f9-01d4-4b4b-8bf0-376d988c1864 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e128ca83d6448c9ab1fe7dcc5467d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a090a68e336b4562aca524a95f550e04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:43.562548 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-11cc34f9-01d4-4b4b-8bf0-376d988c1864 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e" status: 200 len: 1725 microversion: 2.1 time: 0.227205 May 12 14:50:43.563436 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 167/325] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:43 2022] GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e => generated 1725 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:50:43.571591 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-a8887096-8f62-4c9c-974c-e0a62a73a87d tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e423a2656146a7a820f6be3af8d21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c93480a75ab462f9181629c60772257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:43.579784 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-a8887096-8f62-4c9c-974c-e0a62a73a87d tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] 10.222.0.49 "GET /compute/v2.1/servers/68b3c2de-3257-4c79-ad68-f4fea7bfde20" status: 200 len: 1312 microversion: 2.1 time: 0.222376 May 12 14:50:43.580339 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 159/326] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:43 2022] GET /compute/v2.1/servers/68b3c2de-3257-4c79-ad68-f4fea7bfde20 => generated 1312 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:50:43.657058 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-1b71754f-4196-45c3-a249-67e542841ca6 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:43.657667 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-1b71754f-4196-45c3-a249-67e542841ca6 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 944e4e2e-d09f-4dd7-ac42-b037b09dc7c3] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:43.665482 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-1b71754f-4196-45c3-a249-67e542841ca6 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:43.665934 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-1b71754f-4196-45c3-a249-67e542841ca6 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:43.666744 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-1b71754f-4196-45c3-a249-67e542841ca6 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:43.667218 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-1b71754f-4196-45c3-a249-67e542841ca6 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:43.754278 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-486346ca-9fdc-47b6-b28e-4e1e98d31f62 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:43.754988 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-486346ca-9fdc-47b6-b28e-4e1e98d31f62 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 84ccb759-1bc2-4810-8e46-e34c0c29a0d5] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:43.762202 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-486346ca-9fdc-47b6-b28e-4e1e98d31f62 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:43.762650 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-486346ca-9fdc-47b6-b28e-4e1e98d31f62 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:43.763451 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-486346ca-9fdc-47b6-b28e-4e1e98d31f62 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:43.763887 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-486346ca-9fdc-47b6-b28e-4e1e98d31f62 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:43.870447 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-1b71754f-4196-45c3-a249-67e542841ca6 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:43.878666 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-1b71754f-4196-45c3-a249-67e542841ca6 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3" status: 200 len: 1369 microversion: 2.1 time: 0.225533 May 12 14:50:43.879267 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 168/327] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:43 2022] GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3 => generated 1369 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:50:43.962729 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-486346ca-9fdc-47b6-b28e-4e1e98d31f62 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a641a08648b454780081ecc2e291066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a8451272cc41ebaf1598ed940bf09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:43.970689 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-486346ca-9fdc-47b6-b28e-4e1e98d31f62 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/84ccb759-1bc2-4810-8e46-e34c0c29a0d5" status: 200 len: 1366 microversion: 2.1 time: 0.220119 May 12 14:50:43.971919 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 160/328] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:43 2022] GET /compute/v2.1/servers/84ccb759-1bc2-4810-8e46-e34c0c29a0d5 => generated 1366 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:50:44.579509 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-f74d00cd-324b-4114-8db7-691e5820659a tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:44.580129 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-f74d00cd-324b-4114-8db7-691e5820659a tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 3062e66d-4c2a-4212-b186-ecafec6bde2e] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:44.587409 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-f74d00cd-324b-4114-8db7-691e5820659a tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:44.587861 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-f74d00cd-324b-4114-8db7-691e5820659a tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:44.588623 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-f74d00cd-324b-4114-8db7-691e5820659a tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:44.589058 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-f74d00cd-324b-4114-8db7-691e5820659a tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:44.596035 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-8b1a8f8f-d1f8-4898-beed-2b1f732450b5 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:44.596659 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-8b1a8f8f-d1f8-4898-beed-2b1f732450b5 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] [instance: 68b3c2de-3257-4c79-ad68-f4fea7bfde20] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:44.604263 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-8b1a8f8f-d1f8-4898-beed-2b1f732450b5 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:44.604709 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-8b1a8f8f-d1f8-4898-beed-2b1f732450b5 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:44.605474 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-8b1a8f8f-d1f8-4898-beed-2b1f732450b5 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:44.605905 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-8b1a8f8f-d1f8-4898-beed-2b1f732450b5 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:44.787129 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-f74d00cd-324b-4114-8db7-691e5820659a tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e128ca83d6448c9ab1fe7dcc5467d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a090a68e336b4562aca524a95f550e04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:44.796179 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-f74d00cd-324b-4114-8db7-691e5820659a tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e" status: 200 len: 1725 microversion: 2.1 time: 0.220355 May 12 14:50:44.796742 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 169/329] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:44 2022] GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e => generated 1725 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:50:44.805466 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-8b1a8f8f-d1f8-4898-beed-2b1f732450b5 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e423a2656146a7a820f6be3af8d21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c93480a75ab462f9181629c60772257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:44.813459 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-8b1a8f8f-d1f8-4898-beed-2b1f732450b5 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] 10.222.0.49 "GET /compute/v2.1/servers/68b3c2de-3257-4c79-ad68-f4fea7bfde20" status: 200 len: 1312 microversion: 2.1 time: 0.221039 May 12 14:50:44.814006 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 161/330] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:44 2022] GET /compute/v2.1/servers/68b3c2de-3257-4c79-ad68-f4fea7bfde20 => generated 1312 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:50:44.895164 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-ad532d30-3975-480e-91e4-cfb7a2e2f20c tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:44.895797 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-ad532d30-3975-480e-91e4-cfb7a2e2f20c tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 944e4e2e-d09f-4dd7-ac42-b037b09dc7c3] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:44.902940 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-ad532d30-3975-480e-91e4-cfb7a2e2f20c tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:44.903382 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-ad532d30-3975-480e-91e4-cfb7a2e2f20c tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:44.904132 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-ad532d30-3975-480e-91e4-cfb7a2e2f20c tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:44.904561 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-ad532d30-3975-480e-91e4-cfb7a2e2f20c tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:44.988569 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-65636788-3e2e-407b-be96-8e7ff057cac8 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:44.989178 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-65636788-3e2e-407b-be96-8e7ff057cac8 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 84ccb759-1bc2-4810-8e46-e34c0c29a0d5] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:44.996420 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-65636788-3e2e-407b-be96-8e7ff057cac8 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:44.996870 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-65636788-3e2e-407b-be96-8e7ff057cac8 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:44.997640 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-65636788-3e2e-407b-be96-8e7ff057cac8 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:44.998075 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-65636788-3e2e-407b-be96-8e7ff057cac8 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:45.098790 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-ad532d30-3975-480e-91e4-cfb7a2e2f20c tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:45.106946 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-ad532d30-3975-480e-91e4-cfb7a2e2f20c tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3" status: 200 len: 1369 microversion: 2.1 time: 0.215315 May 12 14:50:45.107516 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 170/331] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:44 2022] GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3 => generated 1369 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:50:45.191130 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-65636788-3e2e-407b-be96-8e7ff057cac8 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a641a08648b454780081ecc2e291066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a8451272cc41ebaf1598ed940bf09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:45.199697 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-65636788-3e2e-407b-be96-8e7ff057cac8 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/84ccb759-1bc2-4810-8e46-e34c0c29a0d5" status: 200 len: 1366 microversion: 2.1 time: 0.214825 May 12 14:50:45.200230 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 162/332] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:44 2022] GET /compute/v2.1/servers/84ccb759-1bc2-4810-8e46-e34c0c29a0d5 => generated 1366 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:50:45.813617 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-cad1289f-e735-44a8-ab93-e2e5dc32b6da tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:45.814877 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-cad1289f-e735-44a8-ab93-e2e5dc32b6da tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 3062e66d-4c2a-4212-b186-ecafec6bde2e] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:45.829442 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-cad1289f-e735-44a8-ab93-e2e5dc32b6da tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:45.829442 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-cad1289f-e735-44a8-ab93-e2e5dc32b6da tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:45.829442 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-cad1289f-e735-44a8-ab93-e2e5dc32b6da tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:45.829442 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-cad1289f-e735-44a8-ab93-e2e5dc32b6da tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:45.834016 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-65c916d4-d6ed-4817-84fe-de9984a20041 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:45.834016 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-65c916d4-d6ed-4817-84fe-de9984a20041 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] [instance: 68b3c2de-3257-4c79-ad68-f4fea7bfde20] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:45.841979 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-65c916d4-d6ed-4817-84fe-de9984a20041 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:45.842672 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-65c916d4-d6ed-4817-84fe-de9984a20041 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:45.843501 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-65c916d4-d6ed-4817-84fe-de9984a20041 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:45.843966 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-65c916d4-d6ed-4817-84fe-de9984a20041 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:46.045714 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-cad1289f-e735-44a8-ab93-e2e5dc32b6da tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e128ca83d6448c9ab1fe7dcc5467d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a090a68e336b4562aca524a95f550e04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:46.056151 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-cad1289f-e735-44a8-ab93-e2e5dc32b6da tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e" status: 200 len: 1725 microversion: 2.1 time: 0.246181 May 12 14:50:46.056791 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 171/333] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:45 2022] GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e => generated 1725 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:50:46.124773 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-b9a7b113-a1e3-4885-98ea-7de25a89e040 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:46.125503 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-b9a7b113-a1e3-4885-98ea-7de25a89e040 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 944e4e2e-d09f-4dd7-ac42-b037b09dc7c3] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:46.135225 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-b9a7b113-a1e3-4885-98ea-7de25a89e040 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:46.135673 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-b9a7b113-a1e3-4885-98ea-7de25a89e040 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:46.136868 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-b9a7b113-a1e3-4885-98ea-7de25a89e040 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:46.136868 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-b9a7b113-a1e3-4885-98ea-7de25a89e040 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:46.357594 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-b9a7b113-a1e3-4885-98ea-7de25a89e040 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:46.366385 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-b9a7b113-a1e3-4885-98ea-7de25a89e040 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3" status: 200 len: 1369 microversion: 2.1 time: 0.245586 May 12 14:50:46.367832 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 172/334] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:46 2022] GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3 => generated 1369 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:50:46.381107 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-9f3edbe2-7fe4-4911-82e6-05086b9407a3 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:46.381841 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-9f3edbe2-7fe4-4911-82e6-05086b9407a3 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 84ccb759-1bc2-4810-8e46-e34c0c29a0d5] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:46.389630 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-9f3edbe2-7fe4-4911-82e6-05086b9407a3 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:46.390152 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-9f3edbe2-7fe4-4911-82e6-05086b9407a3 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:46.391056 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-9f3edbe2-7fe4-4911-82e6-05086b9407a3 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:46.391555 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-9f3edbe2-7fe4-4911-82e6-05086b9407a3 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:46.406704 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-65c916d4-d6ed-4817-84fe-de9984a20041 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e423a2656146a7a820f6be3af8d21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c93480a75ab462f9181629c60772257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:46.415153 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-65c916d4-d6ed-4817-84fe-de9984a20041 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] 10.222.0.49 "GET /compute/v2.1/servers/68b3c2de-3257-4c79-ad68-f4fea7bfde20" status: 200 len: 1312 microversion: 2.1 time: 0.588800 May 12 14:50:46.415901 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 163/335] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:45 2022] GET /compute/v2.1/servers/68b3c2de-3257-4c79-ad68-f4fea7bfde20 => generated 1312 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:50:46.612185 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-9f3edbe2-7fe4-4911-82e6-05086b9407a3 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a641a08648b454780081ecc2e291066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a8451272cc41ebaf1598ed940bf09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:46.623352 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-9f3edbe2-7fe4-4911-82e6-05086b9407a3 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/84ccb759-1bc2-4810-8e46-e34c0c29a0d5" status: 200 len: 1366 microversion: 2.1 time: 0.245929 May 12 14:50:46.637785 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 173/336] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:46 2022] GET /compute/v2.1/servers/84ccb759-1bc2-4810-8e46-e34c0c29a0d5 => generated 1366 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:50:47.073925 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-63a1f646-9f61-47fe-a842-b12d487df431 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:47.074575 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-63a1f646-9f61-47fe-a842-b12d487df431 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 3062e66d-4c2a-4212-b186-ecafec6bde2e] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:47.082337 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-63a1f646-9f61-47fe-a842-b12d487df431 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:47.083005 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-63a1f646-9f61-47fe-a842-b12d487df431 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:47.083786 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-63a1f646-9f61-47fe-a842-b12d487df431 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:47.084229 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-63a1f646-9f61-47fe-a842-b12d487df431 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:47.336138 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [req-2b32d48c-fe0b-4754-88da-b8ca79182a00 req-6b46962f-ec5a-4156-b0fa-c8b59b461848 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "944e4e2e-d09f-4dd7-ac42-b037b09dc7c3", "tag": "cb1e67a7-74a2-404f-8058-06c175243b15"}]} {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:50:47.338924 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:50:47.338924 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: warnings.warn(msg) May 12 14:50:47.349458 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [req-2b32d48c-fe0b-4754-88da-b8ca79182a00 req-6b46962f-ec5a-4156-b0fa-c8b59b461848 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:47.350019 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [req-2b32d48c-fe0b-4754-88da-b8ca79182a00 req-6b46962f-ec5a-4156-b0fa-c8b59b461848 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:47.367947 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.compute.server_external_events [req-2b32d48c-fe0b-4754-88da-b8ca79182a00 req-6b46962f-ec5a-4156-b0fa-c8b59b461848 service nova] Creating event network-changed:cb1e67a7-74a2-404f-8058-06c175243b15 for instance 944e4e2e-d09f-4dd7-ac42-b037b09dc7c3 on hv-cinder-83118 May 12 14:50:47.373299 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [req-2b32d48c-fe0b-4754-88da-b8ca79182a00 req-6b46962f-ec5a-4156-b0fa-c8b59b461848 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040781 May 12 14:50:47.374005 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 174/337] 10.222.0.49 () {64 vars in 1317 bytes} [Thu May 12 14:50:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:50:47.384225 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-4a91ecfe-e94d-4f99-a684-ffaf2860a147 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:47.385189 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-4a91ecfe-e94d-4f99-a684-ffaf2860a147 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 944e4e2e-d09f-4dd7-ac42-b037b09dc7c3] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:47.392989 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-4a91ecfe-e94d-4f99-a684-ffaf2860a147 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:47.393441 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-4a91ecfe-e94d-4f99-a684-ffaf2860a147 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:47.394228 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-4a91ecfe-e94d-4f99-a684-ffaf2860a147 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:47.394662 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-4a91ecfe-e94d-4f99-a684-ffaf2860a147 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:47.542916 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-63a1f646-9f61-47fe-a842-b12d487df431 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e128ca83d6448c9ab1fe7dcc5467d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a090a68e336b4562aca524a95f550e04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:47.553409 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-63a1f646-9f61-47fe-a842-b12d487df431 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e" status: 200 len: 1725 microversion: 2.1 time: 0.483643 May 12 14:50:47.555379 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 164/338] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:47 2022] GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e => generated 1725 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:50:47.562526 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-aecfa7b2-a269-4edd-9d63-00d2de0f8f41 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:47.570634 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-aecfa7b2-a269-4edd-9d63-00d2de0f8f41 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] [instance: 68b3c2de-3257-4c79-ad68-f4fea7bfde20] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:47.580280 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-aecfa7b2-a269-4edd-9d63-00d2de0f8f41 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:47.580994 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-aecfa7b2-a269-4edd-9d63-00d2de0f8f41 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:47.581983 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-aecfa7b2-a269-4edd-9d63-00d2de0f8f41 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:47.585646 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-aecfa7b2-a269-4edd-9d63-00d2de0f8f41 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:47.623238 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-4a91ecfe-e94d-4f99-a684-ffaf2860a147 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:47.631426 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-4a91ecfe-e94d-4f99-a684-ffaf2860a147 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3" status: 200 len: 1369 microversion: 2.1 time: 0.251262 May 12 14:50:47.632221 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 175/339] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:47 2022] GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3 => generated 1369 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:50:47.644303 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-b89f8cf7-5ba7-416f-9ce6-6d518b3a5813 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:47.645078 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-b89f8cf7-5ba7-416f-9ce6-6d518b3a5813 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 84ccb759-1bc2-4810-8e46-e34c0c29a0d5] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:47.653160 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-b89f8cf7-5ba7-416f-9ce6-6d518b3a5813 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:47.653714 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-b89f8cf7-5ba7-416f-9ce6-6d518b3a5813 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:47.654649 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-b89f8cf7-5ba7-416f-9ce6-6d518b3a5813 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:47.655182 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-b89f8cf7-5ba7-416f-9ce6-6d518b3a5813 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:47.858988 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-b89f8cf7-5ba7-416f-9ce6-6d518b3a5813 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a641a08648b454780081ecc2e291066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a8451272cc41ebaf1598ed940bf09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:47.868775 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-b89f8cf7-5ba7-416f-9ce6-6d518b3a5813 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/84ccb759-1bc2-4810-8e46-e34c0c29a0d5" status: 200 len: 1556 microversion: 2.1 time: 0.228158 May 12 14:50:47.870859 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 176/340] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:47 2022] GET /compute/v2.1/servers/84ccb759-1bc2-4810-8e46-e34c0c29a0d5 => generated 1556 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:50:47.886124 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-d0fae6b5-c3ae-4010-863b-b970723861d3 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:47.886775 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-d0fae6b5-c3ae-4010-863b-b970723861d3 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 84ccb759-1bc2-4810-8e46-e34c0c29a0d5] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:47.894748 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-d0fae6b5-c3ae-4010-863b-b970723861d3 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:47.900365 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-d0fae6b5-c3ae-4010-863b-b970723861d3 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:47.900365 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-d0fae6b5-c3ae-4010-863b-b970723861d3 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:47.900365 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-d0fae6b5-c3ae-4010-863b-b970723861d3 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:48.071951 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-d0fae6b5-c3ae-4010-863b-b970723861d3 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/84ccb759-1bc2-4810-8e46-e34c0c29a0d5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.190749 May 12 14:50:48.072629 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 177/341] 10.222.0.49 () {58 vars in 1274 bytes} [Thu May 12 14:50:47 2022] GET /compute/v2.1/servers/84ccb759-1bc2-4810-8e46-e34c0c29a0d5/os-interface => generated 284 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 14:50:48.121930 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-aecfa7b2-a269-4edd-9d63-00d2de0f8f41 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e423a2656146a7a820f6be3af8d21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c93480a75ab462f9181629c60772257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:48.132753 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-aecfa7b2-a269-4edd-9d63-00d2de0f8f41 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] 10.222.0.49 "GET /compute/v2.1/servers/68b3c2de-3257-4c79-ad68-f4fea7bfde20" status: 200 len: 1312 microversion: 2.1 time: 0.573593 May 12 14:50:48.133730 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 165/342] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:47 2022] GET /compute/v2.1/servers/68b3c2de-3257-4c79-ad68-f4fea7bfde20 => generated 1312 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:50:48.574730 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-5d0d5e5c-45cd-4f13-b414-1e4beb32d4cc tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:48.575944 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-5d0d5e5c-45cd-4f13-b414-1e4beb32d4cc tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 3062e66d-4c2a-4212-b186-ecafec6bde2e] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:48.583335 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-5d0d5e5c-45cd-4f13-b414-1e4beb32d4cc tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:48.587992 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-5d0d5e5c-45cd-4f13-b414-1e4beb32d4cc tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:48.587992 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-5d0d5e5c-45cd-4f13-b414-1e4beb32d4cc tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:48.587992 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-5d0d5e5c-45cd-4f13-b414-1e4beb32d4cc tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:48.650492 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-556a2576-ae58-49ba-8177-a0660022c7b0 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:48.651600 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-556a2576-ae58-49ba-8177-a0660022c7b0 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 944e4e2e-d09f-4dd7-ac42-b037b09dc7c3] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:48.666151 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-556a2576-ae58-49ba-8177-a0660022c7b0 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:48.666730 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-556a2576-ae58-49ba-8177-a0660022c7b0 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:48.667555 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-556a2576-ae58-49ba-8177-a0660022c7b0 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:48.667997 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-556a2576-ae58-49ba-8177-a0660022c7b0 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:48.921629 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-5d0d5e5c-45cd-4f13-b414-1e4beb32d4cc tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e128ca83d6448c9ab1fe7dcc5467d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a090a68e336b4562aca524a95f550e04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:48.931044 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-5d0d5e5c-45cd-4f13-b414-1e4beb32d4cc tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e" status: 200 len: 1725 microversion: 2.1 time: 0.360073 May 12 14:50:48.931615 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 178/343] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:48 2022] GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e => generated 1725 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:50:48.935939 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-50ef80b8-b157-400a-9233-fe6709565ece tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-998192492", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1024472412", "security_groups": [{"name": "tempest-secgroup-smoke-402515601"}], "networks": [{"uuid": "4c2f6902-97e3-4408-9b2c-59df76c4d77b"}], "block_device_mapping_v2": [{"uuid": "c949c5d2-2bd1-4c49-b39e-cd15fc938b42", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:50:49.100442 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-556a2576-ae58-49ba-8177-a0660022c7b0 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:49.109068 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-556a2576-ae58-49ba-8177-a0660022c7b0 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3" status: 200 len: 1369 microversion: 2.1 time: 0.463562 May 12 14:50:49.119214 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 166/344] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:48 2022] GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3 => generated 1369 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:50:49.150949 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-0d67b5c8-e0e5-48fe-ac2e-56d899ae1f6a tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:49.152321 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-0d67b5c8-e0e5-48fe-ac2e-56d899ae1f6a tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] [instance: 68b3c2de-3257-4c79-ad68-f4fea7bfde20] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:49.162575 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-0d67b5c8-e0e5-48fe-ac2e-56d899ae1f6a tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:49.163982 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-0d67b5c8-e0e5-48fe-ac2e-56d899ae1f6a tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:49.164986 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-0d67b5c8-e0e5-48fe-ac2e-56d899ae1f6a tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:49.165629 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-0d67b5c8-e0e5-48fe-ac2e-56d899ae1f6a tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:49.336959 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.network.neutron [None req-50ef80b8-b157-400a-9233-fe6709565ece tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] validate_networks() for [('4c2f6902-97e3-4408-9b2c-59df76c4d77b', None, None, None)] {{(pid=102213) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} May 12 14:50:49.386993 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-0d67b5c8-e0e5-48fe-ac2e-56d899ae1f6a tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e423a2656146a7a820f6be3af8d21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c93480a75ab462f9181629c60772257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:49.395185 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-0d67b5c8-e0e5-48fe-ac2e-56d899ae1f6a tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] 10.222.0.49 "GET /compute/v2.1/servers/68b3c2de-3257-4c79-ad68-f4fea7bfde20" status: 200 len: 1312 microversion: 2.1 time: 0.249078 May 12 14:50:49.395740 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 167/345] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:49 2022] GET /compute/v2.1/servers/68b3c2de-3257-4c79-ad68-f4fea7bfde20 => generated 1312 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:50:49.948023 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-752f11f9-d87b-4f82-99a0-1ff589ddb1ac tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:49.948696 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-752f11f9-d87b-4f82-99a0-1ff589ddb1ac tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 3062e66d-4c2a-4212-b186-ecafec6bde2e] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:49.956250 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-752f11f9-d87b-4f82-99a0-1ff589ddb1ac tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:49.956695 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-752f11f9-d87b-4f82-99a0-1ff589ddb1ac tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:49.957465 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-752f11f9-d87b-4f82-99a0-1ff589ddb1ac tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:49.957899 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-752f11f9-d87b-4f82-99a0-1ff589ddb1ac tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:50.175097 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-752f11f9-d87b-4f82-99a0-1ff589ddb1ac tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e128ca83d6448c9ab1fe7dcc5467d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a090a68e336b4562aca524a95f550e04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:50.186109 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-752f11f9-d87b-4f82-99a0-1ff589ddb1ac tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e" status: 200 len: 1725 microversion: 2.1 time: 0.241655 May 12 14:50:50.196108 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 168/346] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:49 2022] GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e => generated 1725 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:50:50.196108 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-13d116ad-a6fc-4385-8335-e847e87e38ea tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:50.196108 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-13d116ad-a6fc-4385-8335-e847e87e38ea tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 944e4e2e-d09f-4dd7-ac42-b037b09dc7c3] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:50.199889 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-13d116ad-a6fc-4385-8335-e847e87e38ea tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:50.200535 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-13d116ad-a6fc-4385-8335-e847e87e38ea tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:50.201473 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-13d116ad-a6fc-4385-8335-e847e87e38ea tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:50.202008 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-13d116ad-a6fc-4385-8335-e847e87e38ea tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:50.426120 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-13d116ad-a6fc-4385-8335-e847e87e38ea tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:50.435226 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-13d116ad-a6fc-4385-8335-e847e87e38ea tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3" status: 200 len: 1369 microversion: 2.1 time: 0.246771 May 12 14:50:50.435881 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 169/347] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:50 2022] GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3 => generated 1369 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:50:50.440276 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [req-b73f67e6-6d20-494e-a25b-d854989f857d req-083d2425-fe50-42fc-b0a1-34fd90e03397 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84ccb759-1bc2-4810-8e46-e34c0c29a0d5", "tag": "941ee56d-a8a8-4017-bba8-1c38eaac468b"}]} {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:50:50.442771 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.virt.hardware [None req-50ef80b8-b157-400a-9233-fe6709565ece tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Flavor limits 0:0:0 {{(pid=102213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 14:50:50.443252 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.virt.hardware [None req-50ef80b8-b157-400a-9233-fe6709565ece tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Image limits 0:0:0 {{(pid=102213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 14:50:50.443693 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.virt.hardware [None req-50ef80b8-b157-400a-9233-fe6709565ece tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Flavor pref 0:0:0 {{(pid=102213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 14:50:50.444087 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.virt.hardware [None req-50ef80b8-b157-400a-9233-fe6709565ece tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Image pref 0:0:0 {{(pid=102213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 14:50:50.444539 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.virt.hardware [None req-50ef80b8-b157-400a-9233-fe6709565ece tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=102213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 14:50:50.448974 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:50:50.448974 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: warnings.warn(msg) May 12 14:50:50.453325 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-50ef80b8-b157-400a-9233-fe6709565ece tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:50.453841 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-50ef80b8-b157-400a-9233-fe6709565ece tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:50.454704 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-50ef80b8-b157-400a-9233-fe6709565ece tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:50.455417 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-50ef80b8-b157-400a-9233-fe6709565ece tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:50.458269 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [req-b73f67e6-6d20-494e-a25b-d854989f857d req-083d2425-fe50-42fc-b0a1-34fd90e03397 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:50.458793 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [req-b73f67e6-6d20-494e-a25b-d854989f857d req-083d2425-fe50-42fc-b0a1-34fd90e03397 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:50.472601 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.quota [None req-50ef80b8-b157-400a-9233-fe6709565ece tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Getting quotas for project 0bfe8d8bce3f496d9162c7f9c8727273. Resources: {'cores', 'ram', 'instances'} {{(pid=102213) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 12 14:50:50.474337 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.compute.server_external_events [req-b73f67e6-6d20-494e-a25b-d854989f857d req-083d2425-fe50-42fc-b0a1-34fd90e03397 service nova] Creating event network-changed:941ee56d-a8a8-4017-bba8-1c38eaac468b for instance 84ccb759-1bc2-4810-8e46-e34c0c29a0d5 on hv-cinder-83118 May 12 14:50:50.477318 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.quota [None req-50ef80b8-b157-400a-9233-fe6709565ece tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Getting quotas for user be6d3863350647cdb3091c1006d56c64 and project 0bfe8d8bce3f496d9162c7f9c8727273. Resources: {'cores', 'ram', 'instances'} {{(pid=102213) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 12 14:50:50.479754 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [req-b73f67e6-6d20-494e-a25b-d854989f857d req-083d2425-fe50-42fc-b0a1-34fd90e03397 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042737 May 12 14:50:50.480523 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 170/348] 10.222.0.49 () {64 vars in 1317 bytes} [Thu May 12 14:50:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:50:50.485709 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-25fd31ad-798e-4fba-acd5-5c6fd932dcb4 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:50.486289 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-25fd31ad-798e-4fba-acd5-5c6fd932dcb4 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] [instance: 364ca957-8a0e-45d2-bae2-a850c6708e51] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:50.494143 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-25fd31ad-798e-4fba-acd5-5c6fd932dcb4 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:50.494594 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-25fd31ad-798e-4fba-acd5-5c6fd932dcb4 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:50.496777 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-25fd31ad-798e-4fba-acd5-5c6fd932dcb4 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:50.497223 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-25fd31ad-798e-4fba-acd5-5c6fd932dcb4 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:50.577340 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-50ef80b8-b157-400a-9233-fe6709565ece tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Going to run 1 instances... {{(pid=102213) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 12 14:50:50.579477 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-50ef80b8-b157-400a-9233-fe6709565ece tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] [instance: 7855c920-9df4-495a-9733-78fe42b1705d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c949c5d2-2bd1-4c49-b39e-cd15fc938b42',volume_size=None,volume_type=None)] {{(pid=102213) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} May 12 14:50:50.668609 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.objects.instance [None req-25fd31ad-798e-4fba-acd5-5c6fd932dcb4 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lazy-loading 'services' on Instance uuid 364ca957-8a0e-45d2-bae2-a850c6708e51 {{(pid=102212) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 12 14:50:50.974076 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-25fd31ad-798e-4fba-acd5-5c6fd932dcb4 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] 10.222.0.49 "DELETE /compute/v2.1/servers/364ca957-8a0e-45d2-bae2-a850c6708e51/os-volume_attachments/eb4abdb4-41dd-4398-b68c-1fdee4b2fb5e" status: 202 len: 0 microversion: 2.1 time: 0.492169 May 12 14:50:50.975026 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 171/349] 10.222.0.49 () {58 vars in 1415 bytes} [Thu May 12 14:50:50 2022] DELETE /compute/v2.1/servers/364ca957-8a0e-45d2-bae2-a850c6708e51/os-volume_attachments/eb4abdb4-41dd-4398-b68c-1fdee4b2fb5e => generated 0 bytes in 494 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 14:50:50.981088 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-caf0d995-d9a6-41b9-98b5-fd57a6e7736c tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:50.981968 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-caf0d995-d9a6-41b9-98b5-fd57a6e7736c tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] [instance: 68b3c2de-3257-4c79-ad68-f4fea7bfde20] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:51.017157 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-caf0d995-d9a6-41b9-98b5-fd57a6e7736c tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:51.017790 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-caf0d995-d9a6-41b9-98b5-fd57a6e7736c tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:51.018639 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-caf0d995-d9a6-41b9-98b5-fd57a6e7736c tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:51.019129 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-caf0d995-d9a6-41b9-98b5-fd57a6e7736c tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:51.028802 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-50ef80b8-b157-400a-9233-fe6709565ece tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.096076 May 12 14:50:51.029445 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 179/350] 10.222.0.49 () {60 vars in 1146 bytes} [Thu May 12 14:50:48 2022] POST /compute/v2.1/servers => generated 405 bytes in 2097 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 14:50:51.041496 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-75506708-6c8c-4388-bf58-b68be25b1f12 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:51.042120 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-75506708-6c8c-4388-bf58-b68be25b1f12 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] [instance: 7855c920-9df4-495a-9733-78fe42b1705d] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:51.143296 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-75506708-6c8c-4388-bf58-b68be25b1f12 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6d3863350647cdb3091c1006d56c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfe8d8bce3f496d9162c7f9c8727273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:51.168207 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-75506708-6c8c-4388-bf58-b68be25b1f12 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] 10.222.0.49 "GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d" status: 200 len: 1088 microversion: 2.1 time: 0.132270 May 12 14:50:51.183594 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 180/351] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:51 2022] GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d => generated 1088 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:50:51.204314 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-d416b38a-994f-4cb9-9da8-bde87515e03f tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:51.204940 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-d416b38a-994f-4cb9-9da8-bde87515e03f tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 3062e66d-4c2a-4212-b186-ecafec6bde2e] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:51.239662 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-d416b38a-994f-4cb9-9da8-bde87515e03f tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:51.240105 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-d416b38a-994f-4cb9-9da8-bde87515e03f tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:51.241057 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-d416b38a-994f-4cb9-9da8-bde87515e03f tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:51.241641 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-d416b38a-994f-4cb9-9da8-bde87515e03f tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:51.501892 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-d416b38a-994f-4cb9-9da8-bde87515e03f tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e128ca83d6448c9ab1fe7dcc5467d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a090a68e336b4562aca524a95f550e04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:51.513597 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-d416b38a-994f-4cb9-9da8-bde87515e03f tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e" status: 200 len: 1725 microversion: 2.1 time: 0.313545 May 12 14:50:51.525784 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 181/352] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:51 2022] GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e => generated 1725 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:50:51.532897 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-e98d997f-184f-467b-aeee-3a452aaf582d tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:51.533634 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-e98d997f-184f-467b-aeee-3a452aaf582d tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 944e4e2e-d09f-4dd7-ac42-b037b09dc7c3] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:51.542048 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e98d997f-184f-467b-aeee-3a452aaf582d tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:51.542615 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e98d997f-184f-467b-aeee-3a452aaf582d tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:51.543629 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e98d997f-184f-467b-aeee-3a452aaf582d tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:51.544316 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e98d997f-184f-467b-aeee-3a452aaf582d tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:51.690161 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-caf0d995-d9a6-41b9-98b5-fd57a6e7736c tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e423a2656146a7a820f6be3af8d21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c93480a75ab462f9181629c60772257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:51.698789 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-caf0d995-d9a6-41b9-98b5-fd57a6e7736c tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] 10.222.0.49 "GET /compute/v2.1/servers/68b3c2de-3257-4c79-ad68-f4fea7bfde20" status: 200 len: 1312 microversion: 2.1 time: 0.722224 May 12 14:50:51.708475 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 172/353] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:50 2022] GET /compute/v2.1/servers/68b3c2de-3257-4c79-ad68-f4fea7bfde20 => generated 1312 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:50:51.786939 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-e98d997f-184f-467b-aeee-3a452aaf582d tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:51.795754 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-e98d997f-184f-467b-aeee-3a452aaf582d tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3" status: 200 len: 1369 microversion: 2.1 time: 0.268116 May 12 14:50:51.796321 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 182/354] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:51 2022] GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3 => generated 1369 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:50:52.198245 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-cb3bfed3-7406-4455-bb54-bc83006d627a tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:52.198245 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-cb3bfed3-7406-4455-bb54-bc83006d627a tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] [instance: 7855c920-9df4-495a-9733-78fe42b1705d] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:52.203668 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-cb3bfed3-7406-4455-bb54-bc83006d627a tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:52.204236 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-cb3bfed3-7406-4455-bb54-bc83006d627a tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:52.205138 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-cb3bfed3-7406-4455-bb54-bc83006d627a tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:52.205668 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-cb3bfed3-7406-4455-bb54-bc83006d627a tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:52.334011 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-cb3bfed3-7406-4455-bb54-bc83006d627a tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6d3863350647cdb3091c1006d56c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfe8d8bce3f496d9162c7f9c8727273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:52.342067 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-cb3bfed3-7406-4455-bb54-bc83006d627a tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] 10.222.0.49 "GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d" status: 200 len: 1138 microversion: 2.1 time: 0.154592 May 12 14:50:52.342629 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 173/355] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:52 2022] GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d => generated 1138 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:50:52.530407 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-548acb79-7dcf-4abe-a2dc-253d50b175bc tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:52.531324 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-548acb79-7dcf-4abe-a2dc-253d50b175bc tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 3062e66d-4c2a-4212-b186-ecafec6bde2e] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:52.538397 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-548acb79-7dcf-4abe-a2dc-253d50b175bc tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:52.539375 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-548acb79-7dcf-4abe-a2dc-253d50b175bc tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:52.540150 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-548acb79-7dcf-4abe-a2dc-253d50b175bc tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:52.540588 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-548acb79-7dcf-4abe-a2dc-253d50b175bc tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:52.716083 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-8905d8fb-8093-4cf1-bc7a-08e92da74547 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:52.716684 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-8905d8fb-8093-4cf1-bc7a-08e92da74547 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] [instance: 68b3c2de-3257-4c79-ad68-f4fea7bfde20] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:52.724514 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-8905d8fb-8093-4cf1-bc7a-08e92da74547 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:52.726022 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-8905d8fb-8093-4cf1-bc7a-08e92da74547 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:52.726022 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-8905d8fb-8093-4cf1-bc7a-08e92da74547 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:52.726199 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-8905d8fb-8093-4cf1-bc7a-08e92da74547 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:52.769007 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-548acb79-7dcf-4abe-a2dc-253d50b175bc tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e128ca83d6448c9ab1fe7dcc5467d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a090a68e336b4562aca524a95f550e04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:52.779280 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-548acb79-7dcf-4abe-a2dc-253d50b175bc tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e" status: 200 len: 1725 microversion: 2.1 time: 0.252145 May 12 14:50:52.780282 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 183/356] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:52 2022] GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e => generated 1725 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:50:52.813368 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-227ae913-0d25-4a39-93a0-21394fa72e2c tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:52.813993 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-227ae913-0d25-4a39-93a0-21394fa72e2c tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 944e4e2e-d09f-4dd7-ac42-b037b09dc7c3] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:52.822438 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-227ae913-0d25-4a39-93a0-21394fa72e2c tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:52.822920 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-227ae913-0d25-4a39-93a0-21394fa72e2c tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:52.823897 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-227ae913-0d25-4a39-93a0-21394fa72e2c tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:52.824333 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-227ae913-0d25-4a39-93a0-21394fa72e2c tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:52.971001 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-8905d8fb-8093-4cf1-bc7a-08e92da74547 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e423a2656146a7a820f6be3af8d21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c93480a75ab462f9181629c60772257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:52.982159 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-8905d8fb-8093-4cf1-bc7a-08e92da74547 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] 10.222.0.49 "GET /compute/v2.1/servers/68b3c2de-3257-4c79-ad68-f4fea7bfde20" status: 200 len: 1312 microversion: 2.1 time: 0.269936 May 12 14:50:52.991620 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 174/357] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:52 2022] GET /compute/v2.1/servers/68b3c2de-3257-4c79-ad68-f4fea7bfde20 => generated 1312 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:50:53.046951 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-227ae913-0d25-4a39-93a0-21394fa72e2c tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:53.054947 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-227ae913-0d25-4a39-93a0-21394fa72e2c tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3" status: 200 len: 1369 microversion: 2.1 time: 0.245834 May 12 14:50:53.055515 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 184/358] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:52 2022] GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3 => generated 1369 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:50:53.290549 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-95711521-dadc-48e9-9cc8-b9a406005869 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:53.291072 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-95711521-dadc-48e9-9cc8-b9a406005869 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] [instance: 364ca957-8a0e-45d2-bae2-a850c6708e51] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:53.298320 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-95711521-dadc-48e9-9cc8-b9a406005869 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:53.298706 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-95711521-dadc-48e9-9cc8-b9a406005869 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:53.299504 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-95711521-dadc-48e9-9cc8-b9a406005869 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:53.299946 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-95711521-dadc-48e9-9cc8-b9a406005869 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:53.358488 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-054f7d4f-0644-4541-8ef6-818a911cde1e tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:53.359154 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-054f7d4f-0644-4541-8ef6-818a911cde1e tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] [instance: 7855c920-9df4-495a-9733-78fe42b1705d] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:53.360418 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-95711521-dadc-48e9-9cc8-b9a406005869 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] [instance: 364ca957-8a0e-45d2-bae2-a850c6708e51] Going to try to terminate instance {{(pid=102212) delete /opt/stack/nova/nova/compute/api.py:2562}} May 12 14:50:53.366213 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-054f7d4f-0644-4541-8ef6-818a911cde1e tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:53.366661 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-054f7d4f-0644-4541-8ef6-818a911cde1e tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:53.368023 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-054f7d4f-0644-4541-8ef6-818a911cde1e tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:53.368458 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-054f7d4f-0644-4541-8ef6-818a911cde1e tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:53.631456 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-054f7d4f-0644-4541-8ef6-818a911cde1e tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6d3863350647cdb3091c1006d56c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfe8d8bce3f496d9162c7f9c8727273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:53.639777 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-054f7d4f-0644-4541-8ef6-818a911cde1e tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] 10.222.0.49 "GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d" status: 200 len: 1186 microversion: 2.1 time: 0.284779 May 12 14:50:53.640288 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 185/359] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:53 2022] GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d => generated 1186 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:50:53.667560 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-95711521-dadc-48e9-9cc8-b9a406005869 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] 10.222.0.49 "DELETE /compute/v2.1/servers/364ca957-8a0e-45d2-bae2-a850c6708e51" status: 204 len: 0 microversion: 2.1 time: 0.380867 May 12 14:50:53.668174 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 175/360] 10.222.0.49 () {58 vars in 1238 bytes} [Thu May 12 14:50:53 2022] DELETE /compute/v2.1/servers/364ca957-8a0e-45d2-bae2-a850c6708e51 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 14:50:53.677414 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-081b1d87-e0f6-49c6-b0b5-a32d229534eb tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:53.678024 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-081b1d87-e0f6-49c6-b0b5-a32d229534eb tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] [instance: 364ca957-8a0e-45d2-bae2-a850c6708e51] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:53.685461 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-081b1d87-e0f6-49c6-b0b5-a32d229534eb tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:53.685908 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-081b1d87-e0f6-49c6-b0b5-a32d229534eb tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:53.686683 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-081b1d87-e0f6-49c6-b0b5-a32d229534eb tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:53.689074 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-081b1d87-e0f6-49c6-b0b5-a32d229534eb tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:53.797227 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-24eb9281-7626-423e-aa4f-6df0000c54d0 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:53.797929 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-24eb9281-7626-423e-aa4f-6df0000c54d0 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 3062e66d-4c2a-4212-b186-ecafec6bde2e] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:53.805252 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-24eb9281-7626-423e-aa4f-6df0000c54d0 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:53.805704 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-24eb9281-7626-423e-aa4f-6df0000c54d0 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:53.806655 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-24eb9281-7626-423e-aa4f-6df0000c54d0 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:53.807127 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-24eb9281-7626-423e-aa4f-6df0000c54d0 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:53.892987 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-081b1d87-e0f6-49c6-b0b5-a32d229534eb tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab371128e42444f49bc63661feaf7cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ed089c81294b4981046ede5ed951bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:53.902350 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-081b1d87-e0f6-49c6-b0b5-a32d229534eb tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] 10.222.0.49 "GET /compute/v2.1/servers/364ca957-8a0e-45d2-bae2-a850c6708e51" status: 200 len: 1513 microversion: 2.1 time: 0.228600 May 12 14:50:53.903142 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 186/361] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:53 2022] GET /compute/v2.1/servers/364ca957-8a0e-45d2-bae2-a850c6708e51 => generated 1513 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:50:53.999167 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-fad471d4-e9b1-47c3-bf3f-3db7b19dc654 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:53.999949 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-fad471d4-e9b1-47c3-bf3f-3db7b19dc654 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] [instance: 68b3c2de-3257-4c79-ad68-f4fea7bfde20] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:54.007167 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-fad471d4-e9b1-47c3-bf3f-3db7b19dc654 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:54.008136 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-fad471d4-e9b1-47c3-bf3f-3db7b19dc654 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:54.008999 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-fad471d4-e9b1-47c3-bf3f-3db7b19dc654 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:54.010346 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-fad471d4-e9b1-47c3-bf3f-3db7b19dc654 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:54.084932 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-24eb9281-7626-423e-aa4f-6df0000c54d0 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e128ca83d6448c9ab1fe7dcc5467d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a090a68e336b4562aca524a95f550e04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:54.094851 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-24eb9281-7626-423e-aa4f-6df0000c54d0 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e" status: 200 len: 1725 microversion: 2.1 time: 0.301622 May 12 14:50:54.095356 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 176/362] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:53 2022] GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e => generated 1725 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:50:54.109164 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-0f665e33-e27e-4fbe-b274-8f994116c72c tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:54.109968 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-0f665e33-e27e-4fbe-b274-8f994116c72c tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 944e4e2e-d09f-4dd7-ac42-b037b09dc7c3] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:54.117788 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-0f665e33-e27e-4fbe-b274-8f994116c72c tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:54.117910 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-0f665e33-e27e-4fbe-b274-8f994116c72c tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:54.118612 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-0f665e33-e27e-4fbe-b274-8f994116c72c tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:54.119265 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-0f665e33-e27e-4fbe-b274-8f994116c72c tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:54.238611 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-fad471d4-e9b1-47c3-bf3f-3db7b19dc654 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e423a2656146a7a820f6be3af8d21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c93480a75ab462f9181629c60772257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:54.247494 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-fad471d4-e9b1-47c3-bf3f-3db7b19dc654 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] 10.222.0.49 "GET /compute/v2.1/servers/68b3c2de-3257-4c79-ad68-f4fea7bfde20" status: 200 len: 1312 microversion: 2.1 time: 0.251893 May 12 14:50:54.248377 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 187/363] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:53 2022] GET /compute/v2.1/servers/68b3c2de-3257-4c79-ad68-f4fea7bfde20 => generated 1312 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:50:54.466217 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-0f665e33-e27e-4fbe-b274-8f994116c72c tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:54.474458 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-0f665e33-e27e-4fbe-b274-8f994116c72c tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3" status: 200 len: 1369 microversion: 2.1 time: 0.368706 May 12 14:50:54.475283 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 177/364] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:54 2022] GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3 => generated 1369 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:50:54.657663 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-a83744fd-3494-41a6-89f9-8c7549708d3b tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:54.658281 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-a83744fd-3494-41a6-89f9-8c7549708d3b tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] [instance: 7855c920-9df4-495a-9733-78fe42b1705d] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:54.666698 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-a83744fd-3494-41a6-89f9-8c7549708d3b tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:54.668518 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-a83744fd-3494-41a6-89f9-8c7549708d3b tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:54.668518 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-a83744fd-3494-41a6-89f9-8c7549708d3b tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:54.668518 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-a83744fd-3494-41a6-89f9-8c7549708d3b tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:54.787397 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-a83744fd-3494-41a6-89f9-8c7549708d3b tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6d3863350647cdb3091c1006d56c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfe8d8bce3f496d9162c7f9c8727273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:54.796499 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-a83744fd-3494-41a6-89f9-8c7549708d3b tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] 10.222.0.49 "GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d" status: 200 len: 1204 microversion: 2.1 time: 0.142831 May 12 14:50:54.797076 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 188/365] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:54 2022] GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d => generated 1204 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:50:54.920090 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-ab29cb3e-67d4-453c-b18c-cd2b17daedf6 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:54.920695 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-ab29cb3e-67d4-453c-b18c-cd2b17daedf6 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] [instance: 364ca957-8a0e-45d2-bae2-a850c6708e51] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:54.927949 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-ab29cb3e-67d4-453c-b18c-cd2b17daedf6 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:54.928437 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-ab29cb3e-67d4-453c-b18c-cd2b17daedf6 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:54.929192 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-ab29cb3e-67d4-453c-b18c-cd2b17daedf6 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:54.929765 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-ab29cb3e-67d4-453c-b18c-cd2b17daedf6 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:55.112212 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-54da7878-9d24-4532-8f7e-e9fbd654cf8d tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:55.112824 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-54da7878-9d24-4532-8f7e-e9fbd654cf8d tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 3062e66d-4c2a-4212-b186-ecafec6bde2e] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:55.120241 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-54da7878-9d24-4532-8f7e-e9fbd654cf8d tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:55.120699 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-54da7878-9d24-4532-8f7e-e9fbd654cf8d tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:55.121572 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-54da7878-9d24-4532-8f7e-e9fbd654cf8d tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:55.122031 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-54da7878-9d24-4532-8f7e-e9fbd654cf8d tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:55.147416 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-ab29cb3e-67d4-453c-b18c-cd2b17daedf6 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab371128e42444f49bc63661feaf7cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ed089c81294b4981046ede5ed951bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:55.157268 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-ab29cb3e-67d4-453c-b18c-cd2b17daedf6 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] 10.222.0.49 "GET /compute/v2.1/servers/364ca957-8a0e-45d2-bae2-a850c6708e51" status: 200 len: 1513 microversion: 2.1 time: 0.240876 May 12 14:50:55.166642 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 178/366] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:54 2022] GET /compute/v2.1/servers/364ca957-8a0e-45d2-bae2-a850c6708e51 => generated 1513 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:50:55.265070 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-5a042cab-3ba8-4664-b39b-6ba37a1bc4b4 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:55.265984 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-5a042cab-3ba8-4664-b39b-6ba37a1bc4b4 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] [instance: 68b3c2de-3257-4c79-ad68-f4fea7bfde20] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:55.274019 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-5a042cab-3ba8-4664-b39b-6ba37a1bc4b4 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:55.274758 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-5a042cab-3ba8-4664-b39b-6ba37a1bc4b4 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:55.275846 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-5a042cab-3ba8-4664-b39b-6ba37a1bc4b4 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:55.277572 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-5a042cab-3ba8-4664-b39b-6ba37a1bc4b4 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:55.461896 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-54da7878-9d24-4532-8f7e-e9fbd654cf8d tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e128ca83d6448c9ab1fe7dcc5467d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a090a68e336b4562aca524a95f550e04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:55.477208 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-54da7878-9d24-4532-8f7e-e9fbd654cf8d tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e" status: 200 len: 1725 microversion: 2.1 time: 0.368800 May 12 14:50:55.478921 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 189/367] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:55 2022] GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e => generated 1725 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:50:55.490640 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-58a3dad7-a6d8-4c8c-b123-f2685cdfe8d4 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:55.491073 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-58a3dad7-a6d8-4c8c-b123-f2685cdfe8d4 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 944e4e2e-d09f-4dd7-ac42-b037b09dc7c3] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:55.499082 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-58a3dad7-a6d8-4c8c-b123-f2685cdfe8d4 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:55.499537 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-58a3dad7-a6d8-4c8c-b123-f2685cdfe8d4 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:55.500318 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-58a3dad7-a6d8-4c8c-b123-f2685cdfe8d4 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:55.500768 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-58a3dad7-a6d8-4c8c-b123-f2685cdfe8d4 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:55.689823 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-5a042cab-3ba8-4664-b39b-6ba37a1bc4b4 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e423a2656146a7a820f6be3af8d21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c93480a75ab462f9181629c60772257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:55.703775 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-5a042cab-3ba8-4664-b39b-6ba37a1bc4b4 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] 10.222.0.49 "GET /compute/v2.1/servers/68b3c2de-3257-4c79-ad68-f4fea7bfde20" status: 200 len: 1312 microversion: 2.1 time: 0.442543 May 12 14:50:55.705324 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 179/368] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:55 2022] GET /compute/v2.1/servers/68b3c2de-3257-4c79-ad68-f4fea7bfde20 => generated 1312 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:50:55.725394 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-58a3dad7-a6d8-4c8c-b123-f2685cdfe8d4 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:55.734550 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-58a3dad7-a6d8-4c8c-b123-f2685cdfe8d4 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3" status: 200 len: 1369 microversion: 2.1 time: 0.247780 May 12 14:50:55.735429 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 190/369] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:55 2022] GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3 => generated 1369 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:50:55.797751 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [req-fbb62393-7340-4ab8-a14b-dd0d54955afa req-12f15590-23b1-4dd5-95f0-79e3fc86d0db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68b3c2de-3257-4c79-ad68-f4fea7bfde20", "name": "network-vif-plugged", "status": "completed", "tag": "6e8c413a-feeb-438c-8a0b-999e6b370582"}]} {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:50:55.799381 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:50:55.799381 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: warnings.warn(msg) May 12 14:50:55.808454 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [req-fbb62393-7340-4ab8-a14b-dd0d54955afa req-12f15590-23b1-4dd5-95f0-79e3fc86d0db service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:55.809108 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [req-fbb62393-7340-4ab8-a14b-dd0d54955afa req-12f15590-23b1-4dd5-95f0-79e3fc86d0db service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:55.816492 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-1f289838-f7d8-408b-94c7-7007fe013b41 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:55.817372 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-1f289838-f7d8-408b-94c7-7007fe013b41 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] [instance: 7855c920-9df4-495a-9733-78fe42b1705d] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:55.825457 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-1f289838-f7d8-408b-94c7-7007fe013b41 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:55.826282 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-1f289838-f7d8-408b-94c7-7007fe013b41 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:55.826904 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-1f289838-f7d8-408b-94c7-7007fe013b41 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:55.827425 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-1f289838-f7d8-408b-94c7-7007fe013b41 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:55.834609 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.compute.server_external_events [req-fbb62393-7340-4ab8-a14b-dd0d54955afa req-12f15590-23b1-4dd5-95f0-79e3fc86d0db service nova] Creating event network-vif-plugged:6e8c413a-feeb-438c-8a0b-999e6b370582 for instance 68b3c2de-3257-4c79-ad68-f4fea7bfde20 on hv-cinder-83118 May 12 14:50:55.839397 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [req-fbb62393-7340-4ab8-a14b-dd0d54955afa req-12f15590-23b1-4dd5-95f0-79e3fc86d0db service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045219 May 12 14:50:55.840187 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 180/370] 10.222.0.49 () {64 vars in 1317 bytes} [Thu May 12 14:50:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:50:56.060775 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-1f289838-f7d8-408b-94c7-7007fe013b41 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6d3863350647cdb3091c1006d56c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfe8d8bce3f496d9162c7f9c8727273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:56.075479 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-1f289838-f7d8-408b-94c7-7007fe013b41 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] 10.222.0.49 "GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d" status: 200 len: 1271 microversion: 2.1 time: 0.264738 May 12 14:50:56.076558 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 191/371] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:55 2022] GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d => generated 1271 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:50:56.174313 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-55c044e1-0151-419b-970d-201523cc1ee2 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:56.175077 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-55c044e1-0151-419b-970d-201523cc1ee2 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] [instance: 364ca957-8a0e-45d2-bae2-a850c6708e51] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:56.183144 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-55c044e1-0151-419b-970d-201523cc1ee2 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:56.183594 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-55c044e1-0151-419b-970d-201523cc1ee2 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:56.184365 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-55c044e1-0151-419b-970d-201523cc1ee2 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:56.184811 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-55c044e1-0151-419b-970d-201523cc1ee2 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:56.495999 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-2fdd5c8c-d1fc-4710-a4cc-7f57482b6b4c tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:56.496624 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-2fdd5c8c-d1fc-4710-a4cc-7f57482b6b4c tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 3062e66d-4c2a-4212-b186-ecafec6bde2e] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:56.503979 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-2fdd5c8c-d1fc-4710-a4cc-7f57482b6b4c tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:56.504428 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-2fdd5c8c-d1fc-4710-a4cc-7f57482b6b4c tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:56.505212 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-2fdd5c8c-d1fc-4710-a4cc-7f57482b6b4c tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:56.505653 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-2fdd5c8c-d1fc-4710-a4cc-7f57482b6b4c tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:56.713693 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-2fdd5c8c-d1fc-4710-a4cc-7f57482b6b4c tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e128ca83d6448c9ab1fe7dcc5467d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a090a68e336b4562aca524a95f550e04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:56.722558 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-2fdd5c8c-d1fc-4710-a4cc-7f57482b6b4c tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e" status: 200 len: 1702 microversion: 2.1 time: 0.230861 May 12 14:50:56.723150 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 192/372] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:56 2022] GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e => generated 1702 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:50:56.728028 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-6750bd1b-0d3d-4d07-af08-375b718f7f20 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:56.728629 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-6750bd1b-0d3d-4d07-af08-375b718f7f20 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] [instance: 68b3c2de-3257-4c79-ad68-f4fea7bfde20] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:56.735688 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-6750bd1b-0d3d-4d07-af08-375b718f7f20 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:56.736139 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-6750bd1b-0d3d-4d07-af08-375b718f7f20 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:56.736913 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-6750bd1b-0d3d-4d07-af08-375b718f7f20 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:56.737346 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-6750bd1b-0d3d-4d07-af08-375b718f7f20 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:56.837437 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-55c044e1-0151-419b-970d-201523cc1ee2 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab371128e42444f49bc63661feaf7cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ed089c81294b4981046ede5ed951bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:56.846071 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-55c044e1-0151-419b-970d-201523cc1ee2 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] 10.222.0.49 "GET /compute/v2.1/servers/364ca957-8a0e-45d2-bae2-a850c6708e51" status: 200 len: 1513 microversion: 2.1 time: 0.675816 May 12 14:50:56.846645 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 181/373] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:56 2022] GET /compute/v2.1/servers/364ca957-8a0e-45d2-bae2-a850c6708e51 => generated 1513 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:50:56.857352 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-33e627ff-f619-4d75-bf9e-5e2dc0c3195c tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:50:56.865312 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-33e627ff-f619-4d75-bf9e-5e2dc0c3195c tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:56.865922 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-33e627ff-f619-4d75-bf9e-5e2dc0c3195c tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:56.928510 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-33e627ff-f619-4d75-bf9e-5e2dc0c3195c tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 3062e66d-4c2a-4212-b186-ecafec6bde2e] Going to try to start instance {{(pid=102212) start /opt/stack/nova/nova/compute/api.py:2625}} May 12 14:50:56.946887 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-6750bd1b-0d3d-4d07-af08-375b718f7f20 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e423a2656146a7a820f6be3af8d21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c93480a75ab462f9181629c60772257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:56.955443 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-6750bd1b-0d3d-4d07-af08-375b718f7f20 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] 10.222.0.49 "GET /compute/v2.1/servers/68b3c2de-3257-4c79-ad68-f4fea7bfde20" status: 200 len: 1312 microversion: 2.1 time: 0.231304 May 12 14:50:56.964583 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 193/374] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:56 2022] GET /compute/v2.1/servers/68b3c2de-3257-4c79-ad68-f4fea7bfde20 => generated 1312 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:50:56.964583 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-82a07971-22f1-4556-9cb9-ef34be83ec3c tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:56.964583 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-82a07971-22f1-4556-9cb9-ef34be83ec3c tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 944e4e2e-d09f-4dd7-ac42-b037b09dc7c3] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:56.970049 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-82a07971-22f1-4556-9cb9-ef34be83ec3c tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:56.970603 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-82a07971-22f1-4556-9cb9-ef34be83ec3c tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:56.971508 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-82a07971-22f1-4556-9cb9-ef34be83ec3c tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:56.972046 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-82a07971-22f1-4556-9cb9-ef34be83ec3c tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:57.173595 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-82a07971-22f1-4556-9cb9-ef34be83ec3c tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:57.176849 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-33e627ff-f619-4d75-bf9e-5e2dc0c3195c tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "POST /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e/action" status: 202 len: 0 microversion: 2.1 time: 0.322529 May 12 14:50:57.177545 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 182/375] 10.222.0.49 () {60 vars in 1277 bytes} [Thu May 12 14:50:56 2022] POST /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e/action => generated 0 bytes in 325 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 14:50:57.185611 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-82a07971-22f1-4556-9cb9-ef34be83ec3c tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3" status: 200 len: 1369 microversion: 2.1 time: 0.228165 May 12 14:50:57.186998 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 194/376] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:56 2022] GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3 => generated 1369 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:50:57.187353 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-b06729b8-428f-4436-9f52-1ef5e70df2b4 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:57.188130 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-b06729b8-428f-4436-9f52-1ef5e70df2b4 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] [instance: 7855c920-9df4-495a-9733-78fe42b1705d] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:57.192580 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-72091bf0-cd33-4cc8-a3f2-427701a31119 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:57.193378 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-72091bf0-cd33-4cc8-a3f2-427701a31119 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 3062e66d-4c2a-4212-b186-ecafec6bde2e] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:57.198523 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-b06729b8-428f-4436-9f52-1ef5e70df2b4 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:57.199071 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-b06729b8-428f-4436-9f52-1ef5e70df2b4 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:57.199918 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-b06729b8-428f-4436-9f52-1ef5e70df2b4 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:57.200423 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-b06729b8-428f-4436-9f52-1ef5e70df2b4 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:57.216183 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-72091bf0-cd33-4cc8-a3f2-427701a31119 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:57.216995 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-72091bf0-cd33-4cc8-a3f2-427701a31119 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:57.218059 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-72091bf0-cd33-4cc8-a3f2-427701a31119 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:57.218701 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-72091bf0-cd33-4cc8-a3f2-427701a31119 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:57.434851 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-72091bf0-cd33-4cc8-a3f2-427701a31119 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e128ca83d6448c9ab1fe7dcc5467d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a090a68e336b4562aca524a95f550e04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:57.447246 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-72091bf0-cd33-4cc8-a3f2-427701a31119 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e" status: 200 len: 1711 microversion: 2.1 time: 0.258755 May 12 14:50:57.447922 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 195/377] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:57 2022] GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e => generated 1711 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:50:57.604265 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [req-0f984264-d05c-4911-9a3c-a2012867c282 req-1d7d0d2b-fbfc-4f8c-a731-af4989ee2712 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7855c920-9df4-495a-9733-78fe42b1705d", "tag": "71d6ba38-f010-4812-ade3-cd0173c05466"}]} {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:50:57.606107 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:50:57.606107 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: warnings.warn(msg) May 12 14:50:57.619621 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [req-0f984264-d05c-4911-9a3c-a2012867c282 req-1d7d0d2b-fbfc-4f8c-a731-af4989ee2712 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:57.620064 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [req-0f984264-d05c-4911-9a3c-a2012867c282 req-1d7d0d2b-fbfc-4f8c-a731-af4989ee2712 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:57.659327 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.compute.server_external_events [req-0f984264-d05c-4911-9a3c-a2012867c282 req-1d7d0d2b-fbfc-4f8c-a731-af4989ee2712 service nova] Creating event network-changed:71d6ba38-f010-4812-ade3-cd0173c05466 for instance 7855c920-9df4-495a-9733-78fe42b1705d on hv-cinder-83118 May 12 14:50:57.665506 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [req-0f984264-d05c-4911-9a3c-a2012867c282 req-1d7d0d2b-fbfc-4f8c-a731-af4989ee2712 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066329 May 12 14:50:57.669541 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 196/378] 10.222.0.49 () {64 vars in 1317 bytes} [Thu May 12 14:50:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:50:57.861700 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [req-5c45aed1-af4e-47c4-bb21-201f4f21215d req-713105a5-56a9-4e95-a2ed-1242f59689d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "944e4e2e-d09f-4dd7-ac42-b037b09dc7c3", "name": "network-vif-plugged", "status": "completed", "tag": "cb1e67a7-74a2-404f-8058-06c175243b15"}]} {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:50:57.865333 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:50:57.865333 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: warnings.warn(msg) May 12 14:50:57.875427 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [req-5c45aed1-af4e-47c4-bb21-201f4f21215d req-713105a5-56a9-4e95-a2ed-1242f59689d0 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:57.875878 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [req-5c45aed1-af4e-47c4-bb21-201f4f21215d req-713105a5-56a9-4e95-a2ed-1242f59689d0 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:57.903955 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.compute.server_external_events [req-5c45aed1-af4e-47c4-bb21-201f4f21215d req-713105a5-56a9-4e95-a2ed-1242f59689d0 service nova] Creating event network-vif-plugged:cb1e67a7-74a2-404f-8058-06c175243b15 for instance 944e4e2e-d09f-4dd7-ac42-b037b09dc7c3 on hv-cinder-83118 May 12 14:50:57.909286 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [req-5c45aed1-af4e-47c4-bb21-201f4f21215d req-713105a5-56a9-4e95-a2ed-1242f59689d0 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052502 May 12 14:50:57.909924 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 197/379] 10.222.0.49 () {64 vars in 1317 bytes} [Thu May 12 14:50:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 14:50:57.915527 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-312b38bb-af77-4ba9-8a54-c8be6f847016 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:57.916228 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-312b38bb-af77-4ba9-8a54-c8be6f847016 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] [instance: 364ca957-8a0e-45d2-bae2-a850c6708e51] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:57.924289 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-312b38bb-af77-4ba9-8a54-c8be6f847016 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:57.924765 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-312b38bb-af77-4ba9-8a54-c8be6f847016 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:57.925531 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-312b38bb-af77-4ba9-8a54-c8be6f847016 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:57.925969 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-312b38bb-af77-4ba9-8a54-c8be6f847016 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:58.053671 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-312b38bb-af77-4ba9-8a54-c8be6f847016 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab371128e42444f49bc63661feaf7cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ed089c81294b4981046ede5ed951bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:58.064014 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-312b38bb-af77-4ba9-8a54-c8be6f847016 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] 10.222.0.49 "GET /compute/v2.1/servers/364ca957-8a0e-45d2-bae2-a850c6708e51" status: 200 len: 1471 microversion: 2.1 time: 0.152678 May 12 14:50:58.093237 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 198/380] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:57 2022] GET /compute/v2.1/servers/364ca957-8a0e-45d2-bae2-a850c6708e51 => generated 1471 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:50:58.093237 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-fa98116b-a39a-4de8-a50b-357e5255a7f7 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:58.093237 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-fa98116b-a39a-4de8-a50b-357e5255a7f7 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] [instance: 68b3c2de-3257-4c79-ad68-f4fea7bfde20] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:58.093237 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-fa98116b-a39a-4de8-a50b-357e5255a7f7 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:58.093237 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-fa98116b-a39a-4de8-a50b-357e5255a7f7 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:58.093677 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-fa98116b-a39a-4de8-a50b-357e5255a7f7 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:58.093677 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-fa98116b-a39a-4de8-a50b-357e5255a7f7 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:58.202776 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-b06729b8-428f-4436-9f52-1ef5e70df2b4 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6d3863350647cdb3091c1006d56c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfe8d8bce3f496d9162c7f9c8727273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:58.225236 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-b06729b8-428f-4436-9f52-1ef5e70df2b4 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] 10.222.0.49 "GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d" status: 200 len: 1259 microversion: 2.1 time: 1.042375 May 12 14:50:58.228894 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 183/381] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:57 2022] GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d => generated 1259 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:50:58.241220 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-b8bba86b-cf60-4a66-91e1-5a7bb7c96ecd tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:58.249255 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-b8bba86b-cf60-4a66-91e1-5a7bb7c96ecd tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 944e4e2e-d09f-4dd7-ac42-b037b09dc7c3] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:58.256924 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-b8bba86b-cf60-4a66-91e1-5a7bb7c96ecd tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:58.257373 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-b8bba86b-cf60-4a66-91e1-5a7bb7c96ecd tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:58.263601 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-b8bba86b-cf60-4a66-91e1-5a7bb7c96ecd tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:58.264211 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-b8bba86b-cf60-4a66-91e1-5a7bb7c96ecd tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:58.454175 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-fa98116b-a39a-4de8-a50b-357e5255a7f7 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e423a2656146a7a820f6be3af8d21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c93480a75ab462f9181629c60772257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:58.462422 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-fa98116b-a39a-4de8-a50b-357e5255a7f7 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] 10.222.0.49 "GET /compute/v2.1/servers/68b3c2de-3257-4c79-ad68-f4fea7bfde20" status: 200 len: 1312 microversion: 2.1 time: 0.396346 May 12 14:50:58.471554 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 199/382] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:58 2022] GET /compute/v2.1/servers/68b3c2de-3257-4c79-ad68-f4fea7bfde20 => generated 1312 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:50:58.471554 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-9b101d82-a7fc-4b51-914c-450544635f75 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:58.471554 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-9b101d82-a7fc-4b51-914c-450544635f75 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 3062e66d-4c2a-4212-b186-ecafec6bde2e] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:58.479696 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-9b101d82-a7fc-4b51-914c-450544635f75 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:58.479696 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-9b101d82-a7fc-4b51-914c-450544635f75 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:58.479696 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-9b101d82-a7fc-4b51-914c-450544635f75 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:58.479696 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-9b101d82-a7fc-4b51-914c-450544635f75 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:58.810885 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-9b101d82-a7fc-4b51-914c-450544635f75 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e128ca83d6448c9ab1fe7dcc5467d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a090a68e336b4562aca524a95f550e04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:58.821404 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-9b101d82-a7fc-4b51-914c-450544635f75 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e" status: 200 len: 1711 microversion: 2.1 time: 0.357233 May 12 14:50:58.822202 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 200/383] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:58 2022] GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e => generated 1711 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:50:58.872856 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-b8bba86b-cf60-4a66-91e1-5a7bb7c96ecd tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:58.883929 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-b8bba86b-cf60-4a66-91e1-5a7bb7c96ecd tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3" status: 200 len: 1369 microversion: 2.1 time: 0.651998 May 12 14:50:58.885108 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 184/384] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:58 2022] GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3 => generated 1369 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:50:59.081504 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-90170bd5-615a-49d9-8163-8f398d5eb285 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:59.082136 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-90170bd5-615a-49d9-8163-8f398d5eb285 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] [instance: 364ca957-8a0e-45d2-bae2-a850c6708e51] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:59.089530 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-90170bd5-615a-49d9-8163-8f398d5eb285 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:59.089981 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-90170bd5-615a-49d9-8163-8f398d5eb285 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:59.090749 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-90170bd5-615a-49d9-8163-8f398d5eb285 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:59.091214 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-90170bd5-615a-49d9-8163-8f398d5eb285 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:59.161428 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-90170bd5-615a-49d9-8163-8f398d5eb285 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:59.161874 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-90170bd5-615a-49d9-8163-8f398d5eb285 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:59.162328 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.objects.instance [None req-90170bd5-615a-49d9-8163-8f398d5eb285 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lazy-loading 'fault' on Instance uuid 364ca957-8a0e-45d2-bae2-a850c6708e51 {{(pid=102213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 12 14:50:59.218841 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-90170bd5-615a-49d9-8163-8f398d5eb285 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab371128e42444f49bc63661feaf7cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ed089c81294b4981046ede5ed951bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:59.227256 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-90170bd5-615a-49d9-8163-8f398d5eb285 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] 10.222.0.49 "GET /compute/v2.1/servers/364ca957-8a0e-45d2-bae2-a850c6708e51" status: 200 len: 1309 microversion: 2.1 time: 0.149523 May 12 14:50:59.227814 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 201/385] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:59 2022] GET /compute/v2.1/servers/364ca957-8a0e-45d2-bae2-a850c6708e51 => generated 1309 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:50:59.245366 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-94e1f9d4-2a40-4c41-a175-2520afb56e0c tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:59.245973 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-94e1f9d4-2a40-4c41-a175-2520afb56e0c tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] [instance: 7855c920-9df4-495a-9733-78fe42b1705d] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:59.253269 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-94e1f9d4-2a40-4c41-a175-2520afb56e0c tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:59.253710 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-94e1f9d4-2a40-4c41-a175-2520afb56e0c tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:59.254464 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-94e1f9d4-2a40-4c41-a175-2520afb56e0c tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:59.254918 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-94e1f9d4-2a40-4c41-a175-2520afb56e0c tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:59.479707 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-676dcac3-aa1e-4fe6-8a51-1dad34af270c tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:59.480605 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-676dcac3-aa1e-4fe6-8a51-1dad34af270c tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] [instance: 68b3c2de-3257-4c79-ad68-f4fea7bfde20] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:59.487890 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-676dcac3-aa1e-4fe6-8a51-1dad34af270c tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:59.488340 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-676dcac3-aa1e-4fe6-8a51-1dad34af270c tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:59.489121 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-676dcac3-aa1e-4fe6-8a51-1dad34af270c tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:59.489541 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-676dcac3-aa1e-4fe6-8a51-1dad34af270c tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:59.691311 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-94e1f9d4-2a40-4c41-a175-2520afb56e0c tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6d3863350647cdb3091c1006d56c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfe8d8bce3f496d9162c7f9c8727273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:59.699772 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-94e1f9d4-2a40-4c41-a175-2520afb56e0c tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] 10.222.0.49 "GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d" status: 200 len: 1259 microversion: 2.1 time: 0.458647 May 12 14:50:59.700340 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 185/386] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:59 2022] GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d => generated 1259 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:50:59.705131 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [req-7afb2a98-df27-4ba4-b24a-56041438a6c3 req-c6d8e596-d37c-482a-a970-f64ec0cc3f94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "364ca957-8a0e-45d2-bae2-a850c6708e51", "name": "network-vif-deleted", "tag": "38f74632-a3ba-4b81-ac52-5f899e88b5f7"}]} {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:50:59.706925 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:50:59.706925 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: warnings.warn(msg) May 12 14:50:59.716035 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [req-7afb2a98-df27-4ba4-b24a-56041438a6c3 req-c6d8e596-d37c-482a-a970-f64ec0cc3f94 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:59.716474 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [req-7afb2a98-df27-4ba4-b24a-56041438a6c3 req-c6d8e596-d37c-482a-a970-f64ec0cc3f94 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:59.733251 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.compute.server_external_events [req-7afb2a98-df27-4ba4-b24a-56041438a6c3 req-c6d8e596-d37c-482a-a970-f64ec0cc3f94 service nova] Creating event network-vif-deleted:38f74632-a3ba-4b81-ac52-5f899e88b5f7 for instance 364ca957-8a0e-45d2-bae2-a850c6708e51 on hv-cinder-83118 May 12 14:50:59.737906 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [req-7afb2a98-df27-4ba4-b24a-56041438a6c3 req-c6d8e596-d37c-482a-a970-f64ec0cc3f94 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036221 May 12 14:50:59.738508 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 186/387] 10.222.0.49 () {64 vars in 1317 bytes} [Thu May 12 14:50:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:50:59.774329 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-676dcac3-aa1e-4fe6-8a51-1dad34af270c tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e423a2656146a7a820f6be3af8d21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c93480a75ab462f9181629c60772257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:50:59.782957 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-676dcac3-aa1e-4fe6-8a51-1dad34af270c tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] 10.222.0.49 "GET /compute/v2.1/servers/68b3c2de-3257-4c79-ad68-f4fea7bfde20" status: 200 len: 1496 microversion: 2.1 time: 0.307439 May 12 14:50:59.783529 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 202/388] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:59 2022] GET /compute/v2.1/servers/68b3c2de-3257-4c79-ad68-f4fea7bfde20 => generated 1496 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:50:59.840373 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-db9ab1fb-c5fe-4c2d-a334-49040930591b tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:59.850032 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-db9ab1fb-c5fe-4c2d-a334-49040930591b tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 3062e66d-4c2a-4212-b186-ecafec6bde2e] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:59.867172 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-db9ab1fb-c5fe-4c2d-a334-49040930591b tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:59.867843 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-db9ab1fb-c5fe-4c2d-a334-49040930591b tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:59.870290 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-db9ab1fb-c5fe-4c2d-a334-49040930591b tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:59.872764 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-db9ab1fb-c5fe-4c2d-a334-49040930591b tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:59.901544 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-c403af21-6d06-4c7f-963a-252c79730319 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:50:59.902406 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-c403af21-6d06-4c7f-963a-252c79730319 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 944e4e2e-d09f-4dd7-ac42-b037b09dc7c3] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:50:59.912237 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-c403af21-6d06-4c7f-963a-252c79730319 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:59.912678 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-c403af21-6d06-4c7f-963a-252c79730319 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:50:59.913447 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-c403af21-6d06-4c7f-963a-252c79730319 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:50:59.913937 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-c403af21-6d06-4c7f-963a-252c79730319 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:00.128884 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-db9ab1fb-c5fe-4c2d-a334-49040930591b tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e128ca83d6448c9ab1fe7dcc5467d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a090a68e336b4562aca524a95f550e04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:00.137670 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-db9ab1fb-c5fe-4c2d-a334-49040930591b tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e" status: 200 len: 1711 microversion: 2.1 time: 0.302947 May 12 14:51:00.138249 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 187/389] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:59 2022] GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e => generated 1711 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:51:00.166476 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-c403af21-6d06-4c7f-963a-252c79730319 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:00.174877 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-c403af21-6d06-4c7f-963a-252c79730319 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3" status: 200 len: 1369 microversion: 2.1 time: 0.277311 May 12 14:51:00.175440 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 203/390] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:50:59 2022] GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3 => generated 1369 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:51:00.244642 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-e07818a3-dced-4b68-95a5-bfce82e89f16 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:51:00.245180 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-e07818a3-dced-4b68-95a5-bfce82e89f16 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] [instance: 364ca957-8a0e-45d2-bae2-a850c6708e51] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:51:00.252606 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-e07818a3-dced-4b68-95a5-bfce82e89f16 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:00.253228 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-e07818a3-dced-4b68-95a5-bfce82e89f16 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:00.253790 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-e07818a3-dced-4b68-95a5-bfce82e89f16 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:00.254253 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-e07818a3-dced-4b68-95a5-bfce82e89f16 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:00.328756 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-e07818a3-dced-4b68-95a5-bfce82e89f16 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:00.329203 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-e07818a3-dced-4b68-95a5-bfce82e89f16 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:00.329647 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.objects.instance [None req-e07818a3-dced-4b68-95a5-bfce82e89f16 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lazy-loading 'fault' on Instance uuid 364ca957-8a0e-45d2-bae2-a850c6708e51 {{(pid=102212) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 12 14:51:00.481836 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-e07818a3-dced-4b68-95a5-bfce82e89f16 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab371128e42444f49bc63661feaf7cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ed089c81294b4981046ede5ed951bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:00.489431 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-e07818a3-dced-4b68-95a5-bfce82e89f16 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] 10.222.0.49 "GET /compute/v2.1/servers/364ca957-8a0e-45d2-bae2-a850c6708e51" status: 200 len: 1309 microversion: 2.1 time: 0.249127 May 12 14:51:00.490020 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 188/391] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:51:00 2022] GET /compute/v2.1/servers/364ca957-8a0e-45d2-bae2-a850c6708e51 => generated 1309 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:51:00.716151 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-7ef9b189-92bd-4817-bbcc-7e7855a180e3 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:51:00.716763 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-7ef9b189-92bd-4817-bbcc-7e7855a180e3 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] [instance: 7855c920-9df4-495a-9733-78fe42b1705d] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:51:00.723938 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-7ef9b189-92bd-4817-bbcc-7e7855a180e3 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:00.724388 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-7ef9b189-92bd-4817-bbcc-7e7855a180e3 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:00.725153 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-7ef9b189-92bd-4817-bbcc-7e7855a180e3 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:00.725586 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-7ef9b189-92bd-4817-bbcc-7e7855a180e3 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:00.926744 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-7ef9b189-92bd-4817-bbcc-7e7855a180e3 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6d3863350647cdb3091c1006d56c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfe8d8bce3f496d9162c7f9c8727273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:00.935578 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-7ef9b189-92bd-4817-bbcc-7e7855a180e3 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] 10.222.0.49 "GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d" status: 200 len: 1259 microversion: 2.1 time: 0.223080 May 12 14:51:00.936205 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 204/392] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:51:00 2022] GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d => generated 1259 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:51:01.139976 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-3932bb96-5892-47cb-9c28-246945dff9f3 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:51:01.140429 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-3932bb96-5892-47cb-9c28-246945dff9f3 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] [instance: 68b3c2de-3257-4c79-ad68-f4fea7bfde20] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:51:01.147650 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-3932bb96-5892-47cb-9c28-246945dff9f3 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:01.148175 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-3932bb96-5892-47cb-9c28-246945dff9f3 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:01.148958 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-3932bb96-5892-47cb-9c28-246945dff9f3 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:01.149782 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-3932bb96-5892-47cb-9c28-246945dff9f3 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:01.154408 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-d28c7aa6-85bb-473d-8c04-9f908ddd7116 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:51:01.155253 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-d28c7aa6-85bb-473d-8c04-9f908ddd7116 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 3062e66d-4c2a-4212-b186-ecafec6bde2e] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:51:01.163420 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-d28c7aa6-85bb-473d-8c04-9f908ddd7116 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:01.164053 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-d28c7aa6-85bb-473d-8c04-9f908ddd7116 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:01.167375 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-d28c7aa6-85bb-473d-8c04-9f908ddd7116 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:01.167375 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-d28c7aa6-85bb-473d-8c04-9f908ddd7116 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:01.215189 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-3932bb96-5892-47cb-9c28-246945dff9f3 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] [instance: 68b3c2de-3257-4c79-ad68-f4fea7bfde20] Going to try to terminate instance {{(pid=102212) delete /opt/stack/nova/nova/compute/api.py:2562}} May 12 14:51:01.362245 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-d28c7aa6-85bb-473d-8c04-9f908ddd7116 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e128ca83d6448c9ab1fe7dcc5467d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a090a68e336b4562aca524a95f550e04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:01.371030 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-d28c7aa6-85bb-473d-8c04-9f908ddd7116 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e" status: 200 len: 1715 microversion: 2.1 time: 0.220278 May 12 14:51:01.371688 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 205/393] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:51:01 2022] GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e => generated 1715 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:51:01.376094 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-fcc965bf-fb05-4da9-b7bb-8feac4d24a3f tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:51:01.376724 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-fcc965bf-fb05-4da9-b7bb-8feac4d24a3f tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 944e4e2e-d09f-4dd7-ac42-b037b09dc7c3] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:51:01.383713 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-fcc965bf-fb05-4da9-b7bb-8feac4d24a3f tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:01.384157 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-fcc965bf-fb05-4da9-b7bb-8feac4d24a3f tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:01.387562 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-fcc965bf-fb05-4da9-b7bb-8feac4d24a3f tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:01.387562 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-fcc965bf-fb05-4da9-b7bb-8feac4d24a3f tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:01.488710 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-3932bb96-5892-47cb-9c28-246945dff9f3 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] 10.222.0.49 "DELETE /compute/v2.1/servers/68b3c2de-3257-4c79-ad68-f4fea7bfde20" status: 204 len: 0 microversion: 2.1 time: 0.352168 May 12 14:51:01.489306 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 189/394] 10.222.0.49 () {58 vars in 1238 bytes} [Thu May 12 14:51:01 2022] DELETE /compute/v2.1/servers/68b3c2de-3257-4c79-ad68-f4fea7bfde20 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 14:51:01.497887 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-34612284-bca3-4872-9f80-262fc9b1ec16 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:51:01.498667 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-34612284-bca3-4872-9f80-262fc9b1ec16 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] [instance: 68b3c2de-3257-4c79-ad68-f4fea7bfde20] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:51:01.506086 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-34612284-bca3-4872-9f80-262fc9b1ec16 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:01.506535 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-34612284-bca3-4872-9f80-262fc9b1ec16 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:01.507925 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-34612284-bca3-4872-9f80-262fc9b1ec16 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:01.508391 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-34612284-bca3-4872-9f80-262fc9b1ec16 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:01.588287 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-fcc965bf-fb05-4da9-b7bb-8feac4d24a3f tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:01.596312 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-fcc965bf-fb05-4da9-b7bb-8feac4d24a3f tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3" status: 200 len: 1562 microversion: 2.1 time: 0.223685 May 12 14:51:01.596871 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 206/395] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:51:01 2022] GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3 => generated 1562 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:51:01.601034 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-0739a03d-072e-497d-9a2b-132867b1bd84 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:51:01.601793 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-0739a03d-072e-497d-9a2b-132867b1bd84 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] [instance: 364ca957-8a0e-45d2-bae2-a850c6708e51] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:51:01.608594 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-0739a03d-072e-497d-9a2b-132867b1bd84 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:01.609039 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-0739a03d-072e-497d-9a2b-132867b1bd84 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:01.609795 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-0739a03d-072e-497d-9a2b-132867b1bd84 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:01.610219 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-0739a03d-072e-497d-9a2b-132867b1bd84 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:01.661869 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.wsgi [None req-0739a03d-072e-497d-9a2b-132867b1bd84 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] HTTP exception thrown: Instance 364ca957-8a0e-45d2-bae2-a850c6708e51 could not be found. May 12 14:51:01.662464 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-0739a03d-072e-497d-9a2b-132867b1bd84 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Returning 404 to user: Instance 364ca957-8a0e-45d2-bae2-a850c6708e51 could not be found. {{(pid=102213) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 12 14:51:01.663309 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-0739a03d-072e-497d-9a2b-132867b1bd84 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] 10.222.0.49 "GET /compute/v2.1/servers/364ca957-8a0e-45d2-bae2-a850c6708e51" status: 404 len: 111 microversion: 2.1 time: 0.065542 May 12 14:51:01.664390 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 207/396] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:51:01 2022] GET /compute/v2.1/servers/364ca957-8a0e-45d2-bae2-a850c6708e51 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 14:51:01.668733 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-4c2d429b-10c8-490c-9c6c-a72298569727 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:51:01.669217 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-4c2d429b-10c8-490c-9c6c-a72298569727 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 944e4e2e-d09f-4dd7-ac42-b037b09dc7c3] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:51:01.677255 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-4c2d429b-10c8-490c-9c6c-a72298569727 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:01.677709 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-4c2d429b-10c8-490c-9c6c-a72298569727 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:01.678489 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-4c2d429b-10c8-490c-9c6c-a72298569727 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:01.678966 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-4c2d429b-10c8-490c-9c6c-a72298569727 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:01.705304 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-34612284-bca3-4872-9f80-262fc9b1ec16 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e423a2656146a7a820f6be3af8d21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c93480a75ab462f9181629c60772257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:01.714022 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-34612284-bca3-4872-9f80-262fc9b1ec16 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] 10.222.0.49 "GET /compute/v2.1/servers/68b3c2de-3257-4c79-ad68-f4fea7bfde20" status: 200 len: 1502 microversion: 2.1 time: 0.220073 May 12 14:51:01.714710 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 190/397] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:51:01 2022] GET /compute/v2.1/servers/68b3c2de-3257-4c79-ad68-f4fea7bfde20 => generated 1502 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:51:01.829050 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-4c2d429b-10c8-490c-9c6c-a72298569727 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.163593 May 12 14:51:01.829644 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 208/398] 10.222.0.49 () {58 vars in 1274 bytes} [Thu May 12 14:51:01 2022] GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3/os-interface => generated 284 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:51:01.951329 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-befb5ff0-0689-400b-8861-7fbf2313a76e tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:51:01.951930 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-befb5ff0-0689-400b-8861-7fbf2313a76e tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] [instance: 7855c920-9df4-495a-9733-78fe42b1705d] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:51:01.959145 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-befb5ff0-0689-400b-8861-7fbf2313a76e tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:01.959589 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-befb5ff0-0689-400b-8861-7fbf2313a76e tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:01.960338 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-befb5ff0-0689-400b-8861-7fbf2313a76e tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:01.961262 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-befb5ff0-0689-400b-8861-7fbf2313a76e tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:02.177525 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-befb5ff0-0689-400b-8861-7fbf2313a76e tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6d3863350647cdb3091c1006d56c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfe8d8bce3f496d9162c7f9c8727273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:02.186837 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-befb5ff0-0689-400b-8861-7fbf2313a76e tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] 10.222.0.49 "GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d" status: 200 len: 1259 microversion: 2.1 time: 0.239024 May 12 14:51:02.190876 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 191/399] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:51:01 2022] GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d => generated 1259 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:51:02.732268 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-30b708ad-79cc-498e-bc0a-b56ca9fbf091 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:51:02.732895 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-30b708ad-79cc-498e-bc0a-b56ca9fbf091 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] [instance: 68b3c2de-3257-4c79-ad68-f4fea7bfde20] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:51:02.740108 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-30b708ad-79cc-498e-bc0a-b56ca9fbf091 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:02.740558 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-30b708ad-79cc-498e-bc0a-b56ca9fbf091 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:02.741324 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-30b708ad-79cc-498e-bc0a-b56ca9fbf091 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:02.742251 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-30b708ad-79cc-498e-bc0a-b56ca9fbf091 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:03.167913 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-30b708ad-79cc-498e-bc0a-b56ca9fbf091 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e423a2656146a7a820f6be3af8d21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c93480a75ab462f9181629c60772257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:03.176241 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-30b708ad-79cc-498e-bc0a-b56ca9fbf091 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] 10.222.0.49 "GET /compute/v2.1/servers/68b3c2de-3257-4c79-ad68-f4fea7bfde20" status: 200 len: 1502 microversion: 2.1 time: 0.447692 May 12 14:51:03.177016 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 209/400] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:51:02 2022] GET /compute/v2.1/servers/68b3c2de-3257-4c79-ad68-f4fea7bfde20 => generated 1502 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:51:03.203384 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-bb9d3ef0-267b-4767-9612-f0d88debb963 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:51:03.204416 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-bb9d3ef0-267b-4767-9612-f0d88debb963 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] [instance: 7855c920-9df4-495a-9733-78fe42b1705d] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:51:03.211571 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-bb9d3ef0-267b-4767-9612-f0d88debb963 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:03.212086 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-bb9d3ef0-267b-4767-9612-f0d88debb963 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:03.212946 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-bb9d3ef0-267b-4767-9612-f0d88debb963 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:03.213445 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-bb9d3ef0-267b-4767-9612-f0d88debb963 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:03.407793 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-bb9d3ef0-267b-4767-9612-f0d88debb963 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6d3863350647cdb3091c1006d56c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfe8d8bce3f496d9162c7f9c8727273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:03.416643 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-bb9d3ef0-267b-4767-9612-f0d88debb963 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] 10.222.0.49 "GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d" status: 200 len: 1259 microversion: 2.1 time: 0.216748 May 12 14:51:03.417124 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 192/401] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:51:03 2022] GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d => generated 1259 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:51:03.543180 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [req-32164bf6-2327-4719-9bb8-12dd69ebaa1e req-88e5f333-16c6-4993-a334-0d1eb99a0355 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "944e4e2e-d09f-4dd7-ac42-b037b09dc7c3", "tag": "cb1e67a7-74a2-404f-8058-06c175243b15"}]} {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:51:03.544895 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:51:03.544895 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: warnings.warn(msg) May 12 14:51:03.553306 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [req-32164bf6-2327-4719-9bb8-12dd69ebaa1e req-88e5f333-16c6-4993-a334-0d1eb99a0355 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:03.553834 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [req-32164bf6-2327-4719-9bb8-12dd69ebaa1e req-88e5f333-16c6-4993-a334-0d1eb99a0355 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:03.569176 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.compute.server_external_events [req-32164bf6-2327-4719-9bb8-12dd69ebaa1e req-88e5f333-16c6-4993-a334-0d1eb99a0355 service nova] Creating event network-changed:cb1e67a7-74a2-404f-8058-06c175243b15 for instance 944e4e2e-d09f-4dd7-ac42-b037b09dc7c3 on hv-cinder-83118 May 12 14:51:03.574075 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [req-32164bf6-2327-4719-9bb8-12dd69ebaa1e req-88e5f333-16c6-4993-a334-0d1eb99a0355 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035197 May 12 14:51:03.574660 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 210/402] 10.222.0.49 () {64 vars in 1317 bytes} [Thu May 12 14:51:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:51:04.193327 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-a8e90696-71d2-40de-9951-58847c5fc0eb tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:51:04.194048 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-a8e90696-71d2-40de-9951-58847c5fc0eb tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] [instance: 68b3c2de-3257-4c79-ad68-f4fea7bfde20] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:51:04.201996 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-a8e90696-71d2-40de-9951-58847c5fc0eb tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:04.202513 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-a8e90696-71d2-40de-9951-58847c5fc0eb tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:04.203313 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-a8e90696-71d2-40de-9951-58847c5fc0eb tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:04.203740 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-a8e90696-71d2-40de-9951-58847c5fc0eb tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:04.405609 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-a8e90696-71d2-40de-9951-58847c5fc0eb tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e423a2656146a7a820f6be3af8d21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c93480a75ab462f9181629c60772257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:04.414165 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-a8e90696-71d2-40de-9951-58847c5fc0eb tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] 10.222.0.49 "GET /compute/v2.1/servers/68b3c2de-3257-4c79-ad68-f4fea7bfde20" status: 200 len: 1502 microversion: 2.1 time: 0.224213 May 12 14:51:04.414508 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 193/403] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:51:04 2022] GET /compute/v2.1/servers/68b3c2de-3257-4c79-ad68-f4fea7bfde20 => generated 1502 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:51:04.434486 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-ce3e1012-f632-41df-9d72-860ea671446d tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:51:04.442467 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-ce3e1012-f632-41df-9d72-860ea671446d tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] [instance: 7855c920-9df4-495a-9733-78fe42b1705d] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:51:04.442738 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-ce3e1012-f632-41df-9d72-860ea671446d tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:04.443438 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-ce3e1012-f632-41df-9d72-860ea671446d tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:04.444218 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-ce3e1012-f632-41df-9d72-860ea671446d tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:04.444655 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-ce3e1012-f632-41df-9d72-860ea671446d tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:04.643916 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-ce3e1012-f632-41df-9d72-860ea671446d tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6d3863350647cdb3091c1006d56c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfe8d8bce3f496d9162c7f9c8727273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:04.652389 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-ce3e1012-f632-41df-9d72-860ea671446d tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] 10.222.0.49 "GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d" status: 200 len: 1259 microversion: 2.1 time: 0.222831 May 12 14:51:04.652970 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 211/404] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:51:04 2022] GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d => generated 1259 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:51:05.430514 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-f797edd5-9bdc-4df3-8820-94a81f232b56 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:51:05.431152 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-f797edd5-9bdc-4df3-8820-94a81f232b56 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] [instance: 68b3c2de-3257-4c79-ad68-f4fea7bfde20] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:51:05.438360 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-f797edd5-9bdc-4df3-8820-94a81f232b56 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:05.438799 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-f797edd5-9bdc-4df3-8820-94a81f232b56 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:05.439587 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-f797edd5-9bdc-4df3-8820-94a81f232b56 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:05.440020 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-f797edd5-9bdc-4df3-8820-94a81f232b56 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:05.637045 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-f797edd5-9bdc-4df3-8820-94a81f232b56 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e423a2656146a7a820f6be3af8d21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c93480a75ab462f9181629c60772257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:05.645225 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-f797edd5-9bdc-4df3-8820-94a81f232b56 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] 10.222.0.49 "GET /compute/v2.1/servers/68b3c2de-3257-4c79-ad68-f4fea7bfde20" status: 200 len: 1502 microversion: 2.1 time: 0.218390 May 12 14:51:05.645786 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 194/405] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:51:05 2022] GET /compute/v2.1/servers/68b3c2de-3257-4c79-ad68-f4fea7bfde20 => generated 1502 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:51:05.668210 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-067ae63a-14f4-4c90-a58d-732a7a3fea6d tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:51:05.668745 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-067ae63a-14f4-4c90-a58d-732a7a3fea6d tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] [instance: 7855c920-9df4-495a-9733-78fe42b1705d] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:51:05.675825 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-067ae63a-14f4-4c90-a58d-732a7a3fea6d tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:05.676258 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-067ae63a-14f4-4c90-a58d-732a7a3fea6d tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:05.677059 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-067ae63a-14f4-4c90-a58d-732a7a3fea6d tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:05.677464 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-067ae63a-14f4-4c90-a58d-732a7a3fea6d tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:05.990229 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-067ae63a-14f4-4c90-a58d-732a7a3fea6d tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6d3863350647cdb3091c1006d56c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfe8d8bce3f496d9162c7f9c8727273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:05.999017 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-067ae63a-14f4-4c90-a58d-732a7a3fea6d tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] 10.222.0.49 "GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d" status: 200 len: 1259 microversion: 2.1 time: 0.334428 May 12 14:51:05.999656 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 212/406] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:51:05 2022] GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d => generated 1259 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:51:06.664469 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-2f0c21ce-0a30-4add-a2a7-b12c84af5bb8 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:51:06.665225 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-2f0c21ce-0a30-4add-a2a7-b12c84af5bb8 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] [instance: 68b3c2de-3257-4c79-ad68-f4fea7bfde20] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:51:06.672671 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-2f0c21ce-0a30-4add-a2a7-b12c84af5bb8 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:06.673118 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-2f0c21ce-0a30-4add-a2a7-b12c84af5bb8 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:06.674255 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-2f0c21ce-0a30-4add-a2a7-b12c84af5bb8 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:06.675039 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-2f0c21ce-0a30-4add-a2a7-b12c84af5bb8 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:07.016640 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-28d15f89-c334-4f23-b38f-40d88f824003 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:51:07.017311 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-28d15f89-c334-4f23-b38f-40d88f824003 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] [instance: 7855c920-9df4-495a-9733-78fe42b1705d] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:51:07.025312 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-28d15f89-c334-4f23-b38f-40d88f824003 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:07.025751 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-28d15f89-c334-4f23-b38f-40d88f824003 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:07.026508 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-28d15f89-c334-4f23-b38f-40d88f824003 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:07.026962 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-28d15f89-c334-4f23-b38f-40d88f824003 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:07.199533 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-2f0c21ce-0a30-4add-a2a7-b12c84af5bb8 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e423a2656146a7a820f6be3af8d21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c93480a75ab462f9181629c60772257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:07.206193 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-2f0c21ce-0a30-4add-a2a7-b12c84af5bb8 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] 10.222.0.49 "GET /compute/v2.1/servers/68b3c2de-3257-4c79-ad68-f4fea7bfde20" status: 200 len: 1502 microversion: 2.1 time: 0.545989 May 12 14:51:07.208517 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 195/407] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:51:06 2022] GET /compute/v2.1/servers/68b3c2de-3257-4c79-ad68-f4fea7bfde20 => generated 1502 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:51:07.224087 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-28d15f89-c334-4f23-b38f-40d88f824003 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6d3863350647cdb3091c1006d56c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfe8d8bce3f496d9162c7f9c8727273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:07.234498 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-28d15f89-c334-4f23-b38f-40d88f824003 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] 10.222.0.49 "GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d" status: 200 len: 1259 microversion: 2.1 time: 0.221332 May 12 14:51:07.235507 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 213/408] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:51:07 2022] GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d => generated 1259 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:51:07.452456 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [req-a49cd82d-a195-4ef3-bb18-7d7eae1fbc0b req-2f92319f-9920-4a2d-94ed-bb195e3f523a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68b3c2de-3257-4c79-ad68-f4fea7bfde20", "name": "network-vif-deleted", "tag": "6e8c413a-feeb-438c-8a0b-999e6b370582"}]} {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:51:07.454365 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:51:07.454365 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: warnings.warn(msg) May 12 14:51:07.462386 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [req-a49cd82d-a195-4ef3-bb18-7d7eae1fbc0b req-2f92319f-9920-4a2d-94ed-bb195e3f523a service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:07.462856 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [req-a49cd82d-a195-4ef3-bb18-7d7eae1fbc0b req-2f92319f-9920-4a2d-94ed-bb195e3f523a service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:07.478057 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.compute.server_external_events [req-a49cd82d-a195-4ef3-bb18-7d7eae1fbc0b req-2f92319f-9920-4a2d-94ed-bb195e3f523a service nova] Creating event network-vif-deleted:6e8c413a-feeb-438c-8a0b-999e6b370582 for instance 68b3c2de-3257-4c79-ad68-f4fea7bfde20 on hv-cinder-83118 May 12 14:51:07.482721 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [req-a49cd82d-a195-4ef3-bb18-7d7eae1fbc0b req-2f92319f-9920-4a2d-94ed-bb195e3f523a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033923 May 12 14:51:07.483332 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 196/409] 10.222.0.49 () {64 vars in 1317 bytes} [Thu May 12 14:51:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:51:08.224536 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-048017a2-46fd-45c3-b583-6d5b52fc3656 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:51:08.225149 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-048017a2-46fd-45c3-b583-6d5b52fc3656 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] [instance: 68b3c2de-3257-4c79-ad68-f4fea7bfde20] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:51:08.233412 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-048017a2-46fd-45c3-b583-6d5b52fc3656 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:08.234379 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-048017a2-46fd-45c3-b583-6d5b52fc3656 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:08.234858 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-048017a2-46fd-45c3-b583-6d5b52fc3656 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:08.235161 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-048017a2-46fd-45c3-b583-6d5b52fc3656 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:08.252821 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-66097cf9-0340-473d-99ca-207d3deee533 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:51:08.253584 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-66097cf9-0340-473d-99ca-207d3deee533 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] [instance: 7855c920-9df4-495a-9733-78fe42b1705d] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:51:08.261997 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-66097cf9-0340-473d-99ca-207d3deee533 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:08.262454 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-66097cf9-0340-473d-99ca-207d3deee533 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:08.263250 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-66097cf9-0340-473d-99ca-207d3deee533 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:08.263687 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-66097cf9-0340-473d-99ca-207d3deee533 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:08.322774 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-048017a2-46fd-45c3-b583-6d5b52fc3656 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:08.323302 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-048017a2-46fd-45c3-b583-6d5b52fc3656 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:08.326530 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.objects.instance [None req-048017a2-46fd-45c3-b583-6d5b52fc3656 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lazy-loading 'fault' on Instance uuid 68b3c2de-3257-4c79-ad68-f4fea7bfde20 {{(pid=102213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 12 14:51:08.388143 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-048017a2-46fd-45c3-b583-6d5b52fc3656 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6e423a2656146a7a820f6be3af8d21c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c93480a75ab462f9181629c60772257', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:08.397230 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-048017a2-46fd-45c3-b583-6d5b52fc3656 tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] 10.222.0.49 "GET /compute/v2.1/servers/68b3c2de-3257-4c79-ad68-f4fea7bfde20" status: 200 len: 1302 microversion: 2.1 time: 0.176582 May 12 14:51:08.397902 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 214/410] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:51:08 2022] GET /compute/v2.1/servers/68b3c2de-3257-4c79-ad68-f4fea7bfde20 => generated 1302 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:51:08.481586 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-66097cf9-0340-473d-99ca-207d3deee533 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6d3863350647cdb3091c1006d56c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfe8d8bce3f496d9162c7f9c8727273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:08.489574 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-66097cf9-0340-473d-99ca-207d3deee533 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] 10.222.0.49 "GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d" status: 200 len: 1259 microversion: 2.1 time: 0.240886 May 12 14:51:08.490124 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 197/411] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:51:08 2022] GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d => generated 1259 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:51:09.414634 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-ccaf84bc-5650-4872-bdc4-30b6452596eb tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:51:09.415275 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-ccaf84bc-5650-4872-bdc4-30b6452596eb tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] [instance: 68b3c2de-3257-4c79-ad68-f4fea7bfde20] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:51:09.422559 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-ccaf84bc-5650-4872-bdc4-30b6452596eb tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:09.423047 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-ccaf84bc-5650-4872-bdc4-30b6452596eb tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:09.423817 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-ccaf84bc-5650-4872-bdc4-30b6452596eb tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:09.424255 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-ccaf84bc-5650-4872-bdc4-30b6452596eb tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:09.472833 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.wsgi [None req-ccaf84bc-5650-4872-bdc4-30b6452596eb tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] HTTP exception thrown: Instance 68b3c2de-3257-4c79-ad68-f4fea7bfde20 could not be found. May 12 14:51:09.473424 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-ccaf84bc-5650-4872-bdc4-30b6452596eb tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] Returning 404 to user: Instance 68b3c2de-3257-4c79-ad68-f4fea7bfde20 could not be found. {{(pid=102213) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 12 14:51:09.474240 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-ccaf84bc-5650-4872-bdc4-30b6452596eb tempest-VolumesActionsTest-367389656 tempest-VolumesActionsTest-367389656-project] 10.222.0.49 "GET /compute/v2.1/servers/68b3c2de-3257-4c79-ad68-f4fea7bfde20" status: 404 len: 111 microversion: 2.1 time: 0.063975 May 12 14:51:09.474773 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 215/412] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:51:09 2022] GET /compute/v2.1/servers/68b3c2de-3257-4c79-ad68-f4fea7bfde20 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 14:51:09.505277 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-7db1fd0e-d756-4e94-8f7c-638c6c08ce91 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:51:09.505887 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-7db1fd0e-d756-4e94-8f7c-638c6c08ce91 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] [instance: 7855c920-9df4-495a-9733-78fe42b1705d] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:51:09.513890 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-7db1fd0e-d756-4e94-8f7c-638c6c08ce91 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:09.514356 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-7db1fd0e-d756-4e94-8f7c-638c6c08ce91 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:09.515152 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-7db1fd0e-d756-4e94-8f7c-638c6c08ce91 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:09.515581 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-7db1fd0e-d756-4e94-8f7c-638c6c08ce91 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:09.719814 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-7db1fd0e-d756-4e94-8f7c-638c6c08ce91 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6d3863350647cdb3091c1006d56c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfe8d8bce3f496d9162c7f9c8727273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:09.728763 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-7db1fd0e-d756-4e94-8f7c-638c6c08ce91 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] 10.222.0.49 "GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d" status: 200 len: 1259 microversion: 2.1 time: 0.227157 May 12 14:51:09.729353 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 198/413] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:51:09 2022] GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d => generated 1259 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:51:09.775122 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-6fdbe627-94c1-4aca-a53b-326314565472 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:51:09.775617 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-6fdbe627-94c1-4aca-a53b-326314565472 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:51:09.783044 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-6fdbe627-94c1-4aca-a53b-326314565472 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:09.783493 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-6fdbe627-94c1-4aca-a53b-326314565472 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:09.784255 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-6fdbe627-94c1-4aca-a53b-326314565472 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:09.784687 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-6fdbe627-94c1-4aca-a53b-326314565472 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:09.841245 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-6fdbe627-94c1-4aca-a53b-326314565472 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9/ips" status: 200 len: 151 microversion: 2.20 time: 0.069709 May 12 14:51:09.841808 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 216/414] 10.222.0.49 () {60 vars in 1288 bytes} [Thu May 12 14:51:09 2022] GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9/ips => generated 151 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 14:51:10.745931 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-a31c0ea4-dfea-4e02-9ded-533daa0f31cc tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:51:10.746714 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-a31c0ea4-dfea-4e02-9ded-533daa0f31cc tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] [instance: 7855c920-9df4-495a-9733-78fe42b1705d] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:51:10.754630 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-a31c0ea4-dfea-4e02-9ded-533daa0f31cc tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:10.755107 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-a31c0ea4-dfea-4e02-9ded-533daa0f31cc tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:10.756060 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-a31c0ea4-dfea-4e02-9ded-533daa0f31cc tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:10.756663 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-a31c0ea4-dfea-4e02-9ded-533daa0f31cc tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:10.958983 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-a31c0ea4-dfea-4e02-9ded-533daa0f31cc tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6d3863350647cdb3091c1006d56c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfe8d8bce3f496d9162c7f9c8727273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:10.967400 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-a31c0ea4-dfea-4e02-9ded-533daa0f31cc tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] 10.222.0.49 "GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d" status: 200 len: 1259 microversion: 2.1 time: 0.225536 May 12 14:51:10.968112 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 199/415] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:51:10 2022] GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d => generated 1259 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:51:11.984060 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-7eaefe28-475a-4591-9283-c9839fb0349f tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:51:11.984732 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-7eaefe28-475a-4591-9283-c9839fb0349f tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] [instance: 7855c920-9df4-495a-9733-78fe42b1705d] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:51:11.992032 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-7eaefe28-475a-4591-9283-c9839fb0349f tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:11.992513 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-7eaefe28-475a-4591-9283-c9839fb0349f tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:11.993299 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-7eaefe28-475a-4591-9283-c9839fb0349f tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:11.993737 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-7eaefe28-475a-4591-9283-c9839fb0349f tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:12.186562 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-7eaefe28-475a-4591-9283-c9839fb0349f tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6d3863350647cdb3091c1006d56c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfe8d8bce3f496d9162c7f9c8727273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:12.201339 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-7eaefe28-475a-4591-9283-c9839fb0349f tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] 10.222.0.49 "GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d" status: 200 len: 1259 microversion: 2.1 time: 0.220801 May 12 14:51:12.202363 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 217/416] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:51:11 2022] GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d => generated 1259 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:51:12.833147 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-602d640c-9592-467d-bcc3-711ccc302e3e tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1004537859", "imageRef": "a4587ab2-5f51-46a3-a023-0e6778ccaaa1", "flavorRef": "452", "networks": [{"uuid": "00edf37b-6815-4232-8afc-447b4ec96a1b"}]}} {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:51:12.896464 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.network.neutron [None req-602d640c-9592-467d-bcc3-711ccc302e3e tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] validate_networks() for [('00edf37b-6815-4232-8afc-447b4ec96a1b', None, None, None)] {{(pid=102212) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} May 12 14:51:13.219158 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-3313b8c6-f145-47b7-8952-5aae11ef1959 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:51:13.219783 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-3313b8c6-f145-47b7-8952-5aae11ef1959 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] [instance: 7855c920-9df4-495a-9733-78fe42b1705d] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:51:13.227903 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-3313b8c6-f145-47b7-8952-5aae11ef1959 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:13.228351 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-3313b8c6-f145-47b7-8952-5aae11ef1959 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:13.229130 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-3313b8c6-f145-47b7-8952-5aae11ef1959 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:13.229567 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-3313b8c6-f145-47b7-8952-5aae11ef1959 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:13.371400 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.virt.hardware [None req-602d640c-9592-467d-bcc3-711ccc302e3e tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Flavor limits 0:0:0 {{(pid=102212) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 14:51:13.371827 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.virt.hardware [None req-602d640c-9592-467d-bcc3-711ccc302e3e tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Image limits 0:0:0 {{(pid=102212) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 14:51:13.372301 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.virt.hardware [None req-602d640c-9592-467d-bcc3-711ccc302e3e tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Flavor pref 0:0:0 {{(pid=102212) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 14:51:13.372713 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.virt.hardware [None req-602d640c-9592-467d-bcc3-711ccc302e3e tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Image pref 0:0:0 {{(pid=102212) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 14:51:13.373261 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.virt.hardware [None req-602d640c-9592-467d-bcc3-711ccc302e3e tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=102212) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 14:51:13.381613 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-602d640c-9592-467d-bcc3-711ccc302e3e tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:13.382064 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-602d640c-9592-467d-bcc3-711ccc302e3e tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:13.382891 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-602d640c-9592-467d-bcc3-711ccc302e3e tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:13.383357 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-602d640c-9592-467d-bcc3-711ccc302e3e tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:13.400692 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.quota [None req-602d640c-9592-467d-bcc3-711ccc302e3e tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Getting quotas for project f9ed089c81294b4981046ede5ed951bd. Resources: {'cores', 'ram', 'instances'} {{(pid=102212) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 12 14:51:13.404633 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.quota [None req-602d640c-9592-467d-bcc3-711ccc302e3e tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Getting quotas for user ab371128e42444f49bc63661feaf7cd8 and project f9ed089c81294b4981046ede5ed951bd. Resources: {'cores', 'ram', 'instances'} {{(pid=102212) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 12 14:51:13.415978 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-602d640c-9592-467d-bcc3-711ccc302e3e tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Going to run 1 instances... {{(pid=102212) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 12 14:51:13.418269 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-602d640c-9592-467d-bcc3-711ccc302e3e tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] [instance: 6809f21a-9df9-499a-aec9-c628d50b64e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a4587ab2-5f51-46a3-a023-0e6778ccaaa1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=102212) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} May 12 14:51:13.425615 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-3313b8c6-f145-47b7-8952-5aae11ef1959 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6d3863350647cdb3091c1006d56c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfe8d8bce3f496d9162c7f9c8727273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:13.433792 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-3313b8c6-f145-47b7-8952-5aae11ef1959 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] 10.222.0.49 "GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d" status: 200 len: 1259 microversion: 2.1 time: 0.218559 May 12 14:51:13.434340 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 218/417] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:51:13 2022] GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d => generated 1259 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:51:13.546796 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-602d640c-9592-467d-bcc3-711ccc302e3e tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.717205 May 12 14:51:13.547614 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 200/418] 10.222.0.49 () {60 vars in 1146 bytes} [Thu May 12 14:51:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 718 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 14:51:13.557008 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-69212e3d-35d6-4acc-8d53-7a899e6c0d36 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:51:13.557621 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-69212e3d-35d6-4acc-8d53-7a899e6c0d36 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] [instance: 6809f21a-9df9-499a-aec9-c628d50b64e3] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:51:13.625148 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-69212e3d-35d6-4acc-8d53-7a899e6c0d36 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab371128e42444f49bc63661feaf7cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ed089c81294b4981046ede5ed951bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:13.633073 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-69212e3d-35d6-4acc-8d53-7a899e6c0d36 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] 10.222.0.49 "GET /compute/v2.1/servers/6809f21a-9df9-499a-aec9-c628d50b64e3" status: 200 len: 1219 microversion: 2.1 time: 0.079198 May 12 14:51:13.633714 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 219/419] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:51:13 2022] GET /compute/v2.1/servers/6809f21a-9df9-499a-aec9-c628d50b64e3 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:51:13.771486 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-f58334ce-6910-4148-b96b-bf4607c20511 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:51:13.772006 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-f58334ce-6910-4148-b96b-bf4607c20511 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:51:13.779881 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-f58334ce-6910-4148-b96b-bf4607c20511 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:13.780335 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-f58334ce-6910-4148-b96b-bf4607c20511 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:13.781112 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-f58334ce-6910-4148-b96b-bf4607c20511 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:13.781810 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-f58334ce-6910-4148-b96b-bf4607c20511 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:13.838258 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.objects.instance [None req-f58334ce-6910-4148-b96b-bf4607c20511 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lazy-loading 'flavor' on Instance uuid a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9 {{(pid=102212) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 12 14:51:14.449236 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-ee93b94a-4de4-4a5d-9311-39cfe658ffa2 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:51:14.449867 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-ee93b94a-4de4-4a5d-9311-39cfe658ffa2 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] [instance: 7855c920-9df4-495a-9733-78fe42b1705d] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:51:14.457701 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-ee93b94a-4de4-4a5d-9311-39cfe658ffa2 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:14.459426 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-ee93b94a-4de4-4a5d-9311-39cfe658ffa2 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:14.459426 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-ee93b94a-4de4-4a5d-9311-39cfe658ffa2 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:14.459610 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-ee93b94a-4de4-4a5d-9311-39cfe658ffa2 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:14.669432 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-ee93b94a-4de4-4a5d-9311-39cfe658ffa2 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6d3863350647cdb3091c1006d56c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfe8d8bce3f496d9162c7f9c8727273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:14.677589 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-ee93b94a-4de4-4a5d-9311-39cfe658ffa2 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] 10.222.0.49 "GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d" status: 200 len: 1259 microversion: 2.1 time: 0.232045 May 12 14:51:14.678144 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 220/420] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:51:14 2022] GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d => generated 1259 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:51:14.682357 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-c14394c9-8be8-494d-9294-4adf9beaef9a tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:51:14.683014 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-c14394c9-8be8-494d-9294-4adf9beaef9a tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] [instance: 6809f21a-9df9-499a-aec9-c628d50b64e3] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:51:14.689624 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-c14394c9-8be8-494d-9294-4adf9beaef9a tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:14.690068 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-c14394c9-8be8-494d-9294-4adf9beaef9a tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:14.690851 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-c14394c9-8be8-494d-9294-4adf9beaef9a tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:14.691290 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-c14394c9-8be8-494d-9294-4adf9beaef9a tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:14.732574 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-f58334ce-6910-4148-b96b-bf4607c20511 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "POST /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9/action" status: 202 len: 0 microversion: 2.20 time: 0.964642 May 12 14:51:14.740267 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 201/421] 10.222.0.49 () {62 vars in 1318 bytes} [Thu May 12 14:51:13 2022] POST /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9/action => generated 0 bytes in 966 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 12 14:51:14.743303 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-bbefe31c-c722-4f5c-9f7b-cf0e40bfd72f tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:51:14.744005 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-bbefe31c-c722-4f5c-9f7b-cf0e40bfd72f tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:51:14.751793 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-bbefe31c-c722-4f5c-9f7b-cf0e40bfd72f tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:14.753565 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-bbefe31c-c722-4f5c-9f7b-cf0e40bfd72f tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:14.754806 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-bbefe31c-c722-4f5c-9f7b-cf0e40bfd72f tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:14.755321 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-bbefe31c-c722-4f5c-9f7b-cf0e40bfd72f tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:14.816321 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-c14394c9-8be8-494d-9294-4adf9beaef9a tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab371128e42444f49bc63661feaf7cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ed089c81294b4981046ede5ed951bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:14.824489 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-c14394c9-8be8-494d-9294-4adf9beaef9a tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] 10.222.0.49 "GET /compute/v2.1/servers/6809f21a-9df9-499a-aec9-c628d50b64e3" status: 200 len: 1223 microversion: 2.1 time: 0.145364 May 12 14:51:14.825046 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 221/422] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:51:14 2022] GET /compute/v2.1/servers/6809f21a-9df9-499a-aec9-c628d50b64e3 => generated 1223 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:51:14.989218 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-bbefe31c-c722-4f5c-9f7b-cf0e40bfd72f tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:14.998074 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-bbefe31c-c722-4f5c-9f7b-cf0e40bfd72f tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:15.003697 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-bbefe31c-c722-4f5c-9f7b-cf0e40bfd72f tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:15.003697 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-bbefe31c-c722-4f5c-9f7b-cf0e40bfd72f tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9" status: 200 len: 1723 microversion: 2.20 time: 0.263093 May 12 14:51:15.003697 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 202/423] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:51:14 2022] GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9 => generated 1723 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 14:51:15.693891 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-b013e65b-3dd1-406c-9da0-120841b39114 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:51:15.694430 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-b013e65b-3dd1-406c-9da0-120841b39114 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] [instance: 7855c920-9df4-495a-9733-78fe42b1705d] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:51:15.702115 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-b013e65b-3dd1-406c-9da0-120841b39114 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:15.702559 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-b013e65b-3dd1-406c-9da0-120841b39114 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:15.703350 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-b013e65b-3dd1-406c-9da0-120841b39114 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:15.703830 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-b013e65b-3dd1-406c-9da0-120841b39114 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:15.841765 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-7484f4c5-1a6e-4ad5-bdb0-ef7af01a62f2 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:51:15.842369 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-7484f4c5-1a6e-4ad5-bdb0-ef7af01a62f2 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] [instance: 6809f21a-9df9-499a-aec9-c628d50b64e3] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:51:15.849635 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-7484f4c5-1a6e-4ad5-bdb0-ef7af01a62f2 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:15.850085 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-7484f4c5-1a6e-4ad5-bdb0-ef7af01a62f2 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:15.850967 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-7484f4c5-1a6e-4ad5-bdb0-ef7af01a62f2 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:15.851404 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-7484f4c5-1a6e-4ad5-bdb0-ef7af01a62f2 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:15.902315 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-b013e65b-3dd1-406c-9da0-120841b39114 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6d3863350647cdb3091c1006d56c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfe8d8bce3f496d9162c7f9c8727273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:15.912182 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-b013e65b-3dd1-406c-9da0-120841b39114 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] 10.222.0.49 "GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d" status: 200 len: 1259 microversion: 2.1 time: 0.222021 May 12 14:51:15.912768 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 222/424] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:51:15 2022] GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d => generated 1259 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:51:15.973459 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-7484f4c5-1a6e-4ad5-bdb0-ef7af01a62f2 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab371128e42444f49bc63661feaf7cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ed089c81294b4981046ede5ed951bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:15.981475 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-7484f4c5-1a6e-4ad5-bdb0-ef7af01a62f2 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] 10.222.0.49 "GET /compute/v2.1/servers/6809f21a-9df9-499a-aec9-c628d50b64e3" status: 200 len: 1271 microversion: 2.1 time: 0.143502 May 12 14:51:15.982027 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 203/425] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:51:15 2022] GET /compute/v2.1/servers/6809f21a-9df9-499a-aec9-c628d50b64e3 => generated 1271 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:51:16.021015 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-db1d9e67-d1ca-4d29-9271-cf981e01dad9 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:51:16.021656 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-db1d9e67-d1ca-4d29-9271-cf981e01dad9 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:51:16.029015 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-db1d9e67-d1ca-4d29-9271-cf981e01dad9 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:16.029469 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-db1d9e67-d1ca-4d29-9271-cf981e01dad9 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:16.030240 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-db1d9e67-d1ca-4d29-9271-cf981e01dad9 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:16.030678 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-db1d9e67-d1ca-4d29-9271-cf981e01dad9 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:16.222491 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-db1d9e67-d1ca-4d29-9271-cf981e01dad9 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:16.232040 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-db1d9e67-d1ca-4d29-9271-cf981e01dad9 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:16.233564 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-db1d9e67-d1ca-4d29-9271-cf981e01dad9 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:16.234690 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-db1d9e67-d1ca-4d29-9271-cf981e01dad9 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9" status: 200 len: 1723 microversion: 2.20 time: 0.217450 May 12 14:51:16.236480 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 223/426] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:51:16 2022] GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9 => generated 1723 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:51:16.931275 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-274fc79e-82fd-46f8-a9f9-c1049fc2e6aa tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:51:16.934073 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-274fc79e-82fd-46f8-a9f9-c1049fc2e6aa tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] [instance: 7855c920-9df4-495a-9733-78fe42b1705d] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:51:16.949126 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-274fc79e-82fd-46f8-a9f9-c1049fc2e6aa tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:16.949726 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-274fc79e-82fd-46f8-a9f9-c1049fc2e6aa tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:16.950774 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-274fc79e-82fd-46f8-a9f9-c1049fc2e6aa tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:16.951616 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-274fc79e-82fd-46f8-a9f9-c1049fc2e6aa tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:16.998847 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-4e440fb7-3d08-482b-9bf5-f9d371cdf6fa tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:51:17.005674 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-4e440fb7-3d08-482b-9bf5-f9d371cdf6fa tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] [instance: 6809f21a-9df9-499a-aec9-c628d50b64e3] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:51:17.017294 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-4e440fb7-3d08-482b-9bf5-f9d371cdf6fa tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:17.017756 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-4e440fb7-3d08-482b-9bf5-f9d371cdf6fa tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:17.024542 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-4e440fb7-3d08-482b-9bf5-f9d371cdf6fa tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:17.027978 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-4e440fb7-3d08-482b-9bf5-f9d371cdf6fa tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:17.272294 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-4e440fb7-3d08-482b-9bf5-f9d371cdf6fa tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab371128e42444f49bc63661feaf7cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ed089c81294b4981046ede5ed951bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:17.283353 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-4e440fb7-3d08-482b-9bf5-f9d371cdf6fa tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] 10.222.0.49 "GET /compute/v2.1/servers/6809f21a-9df9-499a-aec9-c628d50b64e3" status: 200 len: 1289 microversion: 2.1 time: 0.288472 May 12 14:51:17.284749 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 224/427] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:51:16 2022] GET /compute/v2.1/servers/6809f21a-9df9-499a-aec9-c628d50b64e3 => generated 1289 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:51:17.297496 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-2e051848-eafa-42ae-a471-ca8ac45db972 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:51:17.298447 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-2e051848-eafa-42ae-a471-ca8ac45db972 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:51:17.313796 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-2e051848-eafa-42ae-a471-ca8ac45db972 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:17.314245 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-2e051848-eafa-42ae-a471-ca8ac45db972 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:17.322307 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-2e051848-eafa-42ae-a471-ca8ac45db972 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:17.323017 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-2e051848-eafa-42ae-a471-ca8ac45db972 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:17.552606 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-2e051848-eafa-42ae-a471-ca8ac45db972 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:17.563067 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-2e051848-eafa-42ae-a471-ca8ac45db972 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:17.564910 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-2e051848-eafa-42ae-a471-ca8ac45db972 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:17.566279 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-2e051848-eafa-42ae-a471-ca8ac45db972 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9" status: 200 len: 1723 microversion: 2.20 time: 0.280367 May 12 14:51:17.577738 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 225/428] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:51:17 2022] GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9 => generated 1723 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:51:17.641480 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [req-c20d142d-d2c7-4c08-b952-1daf2d480951 req-c87cfef5-70fd-4c1a-9f36-ca3c145a4fbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7855c920-9df4-495a-9733-78fe42b1705d", "name": "network-vif-plugged", "status": "completed", "tag": "71d6ba38-f010-4812-ade3-cd0173c05466"}]} {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:51:17.643888 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:51:17.643888 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: warnings.warn(msg) May 12 14:51:17.677105 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [req-c20d142d-d2c7-4c08-b952-1daf2d480951 req-c87cfef5-70fd-4c1a-9f36-ca3c145a4fbc service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:17.680146 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [req-c20d142d-d2c7-4c08-b952-1daf2d480951 req-c87cfef5-70fd-4c1a-9f36-ca3c145a4fbc service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:17.733795 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.compute.server_external_events [req-c20d142d-d2c7-4c08-b952-1daf2d480951 req-c87cfef5-70fd-4c1a-9f36-ca3c145a4fbc service nova] Creating event network-vif-plugged:71d6ba38-f010-4812-ade3-cd0173c05466 for instance 7855c920-9df4-495a-9733-78fe42b1705d on hv-cinder-83118 May 12 14:51:17.742452 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [req-c20d142d-d2c7-4c08-b952-1daf2d480951 req-c87cfef5-70fd-4c1a-9f36-ca3c145a4fbc service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105292 May 12 14:51:17.743998 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 226/429] 10.222.0.49 () {64 vars in 1317 bytes} [Thu May 12 14:51:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:51:17.759004 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-274fc79e-82fd-46f8-a9f9-c1049fc2e6aa tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6d3863350647cdb3091c1006d56c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfe8d8bce3f496d9162c7f9c8727273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:17.777208 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-274fc79e-82fd-46f8-a9f9-c1049fc2e6aa tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] 10.222.0.49 "GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d" status: 200 len: 1259 microversion: 2.1 time: 0.851504 May 12 14:51:17.779405 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 204/430] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:51:16 2022] GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d => generated 1259 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:51:18.303305 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-62e7da08-1afe-4adc-bb0d-b223be3c97e4 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:51:18.306253 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-62e7da08-1afe-4adc-bb0d-b223be3c97e4 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] [instance: 6809f21a-9df9-499a-aec9-c628d50b64e3] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:51:18.317488 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-62e7da08-1afe-4adc-bb0d-b223be3c97e4 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:18.318544 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-62e7da08-1afe-4adc-bb0d-b223be3c97e4 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:18.320583 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-62e7da08-1afe-4adc-bb0d-b223be3c97e4 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:18.321464 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-62e7da08-1afe-4adc-bb0d-b223be3c97e4 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:18.592695 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-b189f723-e487-4abf-aef4-9a6786958cbd tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:51:18.597206 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-b189f723-e487-4abf-aef4-9a6786958cbd tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:51:18.610569 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-b189f723-e487-4abf-aef4-9a6786958cbd tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:18.611685 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-b189f723-e487-4abf-aef4-9a6786958cbd tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:18.612924 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-b189f723-e487-4abf-aef4-9a6786958cbd tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:18.613596 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-b189f723-e487-4abf-aef4-9a6786958cbd tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:18.774665 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-62e7da08-1afe-4adc-bb0d-b223be3c97e4 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab371128e42444f49bc63661feaf7cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ed089c81294b4981046ede5ed951bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:18.785630 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-62e7da08-1afe-4adc-bb0d-b223be3c97e4 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] 10.222.0.49 "GET /compute/v2.1/servers/6809f21a-9df9-499a-aec9-c628d50b64e3" status: 200 len: 1319 microversion: 2.1 time: 0.487874 May 12 14:51:18.788242 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 227/431] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:51:18 2022] GET /compute/v2.1/servers/6809f21a-9df9-499a-aec9-c628d50b64e3 => generated 1319 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:51:18.795799 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-6cf4da36-bf5c-4fcf-b77a-9f4753128885 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:51:18.796505 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-6cf4da36-bf5c-4fcf-b77a-9f4753128885 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] [instance: 7855c920-9df4-495a-9733-78fe42b1705d] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:51:18.812243 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-6cf4da36-bf5c-4fcf-b77a-9f4753128885 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:18.812815 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-6cf4da36-bf5c-4fcf-b77a-9f4753128885 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:18.813652 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-6cf4da36-bf5c-4fcf-b77a-9f4753128885 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:18.814147 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-6cf4da36-bf5c-4fcf-b77a-9f4753128885 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:19.056749 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-6cf4da36-bf5c-4fcf-b77a-9f4753128885 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6d3863350647cdb3091c1006d56c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfe8d8bce3f496d9162c7f9c8727273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:19.064665 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-b189f723-e487-4abf-aef4-9a6786958cbd tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:19.076474 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-6cf4da36-bf5c-4fcf-b77a-9f4753128885 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] 10.222.0.49 "GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d" status: 200 len: 1259 microversion: 2.1 time: 0.278963 May 12 14:51:19.076710 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-b189f723-e487-4abf-aef4-9a6786958cbd tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:19.078928 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-b189f723-e487-4abf-aef4-9a6786958cbd tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:19.079093 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 228/432] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:51:18 2022] GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d => generated 1259 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:51:19.080907 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-b189f723-e487-4abf-aef4-9a6786958cbd tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9" status: 200 len: 1723 microversion: 2.20 time: 0.497897 May 12 14:51:19.082030 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 205/433] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:51:18 2022] GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9 => generated 1723 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:51:19.807533 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-43c795e8-d0ce-4948-a498-95e3b48fe521 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:51:19.808504 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-43c795e8-d0ce-4948-a498-95e3b48fe521 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] [instance: 6809f21a-9df9-499a-aec9-c628d50b64e3] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:51:19.825196 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-43c795e8-d0ce-4948-a498-95e3b48fe521 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:19.828922 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-43c795e8-d0ce-4948-a498-95e3b48fe521 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:19.828922 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-43c795e8-d0ce-4948-a498-95e3b48fe521 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:19.828922 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-43c795e8-d0ce-4948-a498-95e3b48fe521 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:19.999015 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [req-2497b856-8c14-428c-a74b-36a7fa1daf04 req-1557d2ed-318b-4dcd-bf49-5d828f49d341 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6809f21a-9df9-499a-aec9-c628d50b64e3", "tag": "89a9ff10-8343-460a-9e65-0158c87f5841"}]} {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:51:20.001636 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:51:20.001636 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: warnings.warn(msg) May 12 14:51:20.016504 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [req-2497b856-8c14-428c-a74b-36a7fa1daf04 req-1557d2ed-318b-4dcd-bf49-5d828f49d341 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:20.017316 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [req-2497b856-8c14-428c-a74b-36a7fa1daf04 req-1557d2ed-318b-4dcd-bf49-5d828f49d341 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:20.035724 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.compute.server_external_events [req-2497b856-8c14-428c-a74b-36a7fa1daf04 req-1557d2ed-318b-4dcd-bf49-5d828f49d341 service nova] Creating event network-changed:89a9ff10-8343-460a-9e65-0158c87f5841 for instance 6809f21a-9df9-499a-aec9-c628d50b64e3 on hv-cinder-83118 May 12 14:51:20.040933 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [req-2497b856-8c14-428c-a74b-36a7fa1daf04 req-1557d2ed-318b-4dcd-bf49-5d828f49d341 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045896 May 12 14:51:20.041526 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 206/434] 10.222.0.49 () {64 vars in 1317 bytes} [Thu May 12 14:51:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 14:51:20.073810 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-43c795e8-d0ce-4948-a498-95e3b48fe521 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab371128e42444f49bc63661feaf7cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ed089c81294b4981046ede5ed951bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:20.081889 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-43c795e8-d0ce-4948-a498-95e3b48fe521 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] 10.222.0.49 "GET /compute/v2.1/servers/6809f21a-9df9-499a-aec9-c628d50b64e3" status: 200 len: 1319 microversion: 2.1 time: 0.280324 May 12 14:51:20.082571 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 229/435] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:51:19 2022] GET /compute/v2.1/servers/6809f21a-9df9-499a-aec9-c628d50b64e3 => generated 1319 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:51:20.101763 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-ba477deb-4efd-4777-a24e-ed8f9748af5d tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:51:20.102935 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-ba477deb-4efd-4777-a24e-ed8f9748af5d tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] [instance: 7855c920-9df4-495a-9733-78fe42b1705d] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:51:20.104315 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-c6b5be0b-c7ca-4b0d-8879-7ef5c1a6deb7 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:51:20.105402 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-c6b5be0b-c7ca-4b0d-8879-7ef5c1a6deb7 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:51:20.115589 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-ba477deb-4efd-4777-a24e-ed8f9748af5d tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:20.117245 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-ba477deb-4efd-4777-a24e-ed8f9748af5d tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:20.118242 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-c6b5be0b-c7ca-4b0d-8879-7ef5c1a6deb7 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:20.118981 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-ba477deb-4efd-4777-a24e-ed8f9748af5d tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:20.119166 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-c6b5be0b-c7ca-4b0d-8879-7ef5c1a6deb7 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:20.120098 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-ba477deb-4efd-4777-a24e-ed8f9748af5d tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:20.120289 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-c6b5be0b-c7ca-4b0d-8879-7ef5c1a6deb7 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:20.120954 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-c6b5be0b-c7ca-4b0d-8879-7ef5c1a6deb7 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:20.435704 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-c6b5be0b-c7ca-4b0d-8879-7ef5c1a6deb7 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:20.450043 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-c6b5be0b-c7ca-4b0d-8879-7ef5c1a6deb7 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:20.452378 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-c6b5be0b-c7ca-4b0d-8879-7ef5c1a6deb7 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:20.453700 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-c6b5be0b-c7ca-4b0d-8879-7ef5c1a6deb7 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9" status: 200 len: 1723 microversion: 2.20 time: 0.356417 May 12 14:51:20.454550 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 230/436] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:51:20 2022] GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9 => generated 1723 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:51:20.689338 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-ba477deb-4efd-4777-a24e-ed8f9748af5d tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6d3863350647cdb3091c1006d56c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfe8d8bce3f496d9162c7f9c8727273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:20.698856 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-ba477deb-4efd-4777-a24e-ed8f9748af5d tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] 10.222.0.49 "GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d" status: 200 len: 1259 microversion: 2.1 time: 0.604226 May 12 14:51:20.708752 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 207/437] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:51:20 2022] GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d => generated 1259 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:51:21.097990 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-65219aa2-e692-4328-8c01-e095483d37dd tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:51:21.098582 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-65219aa2-e692-4328-8c01-e095483d37dd tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] [instance: 6809f21a-9df9-499a-aec9-c628d50b64e3] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:51:21.111096 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-65219aa2-e692-4328-8c01-e095483d37dd tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:21.111543 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-65219aa2-e692-4328-8c01-e095483d37dd tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:21.112345 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-65219aa2-e692-4328-8c01-e095483d37dd tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:21.112777 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-65219aa2-e692-4328-8c01-e095483d37dd tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:21.360995 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-65219aa2-e692-4328-8c01-e095483d37dd tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab371128e42444f49bc63661feaf7cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ed089c81294b4981046ede5ed951bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:21.371171 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-65219aa2-e692-4328-8c01-e095483d37dd tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] 10.222.0.49 "GET /compute/v2.1/servers/6809f21a-9df9-499a-aec9-c628d50b64e3" status: 200 len: 1319 microversion: 2.1 time: 0.276535 May 12 14:51:21.381344 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 231/438] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:51:21 2022] GET /compute/v2.1/servers/6809f21a-9df9-499a-aec9-c628d50b64e3 => generated 1319 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:51:21.473624 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-8c6e20fd-f6f9-4cfb-8d89-22372423f630 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:51:21.473624 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-8c6e20fd-f6f9-4cfb-8d89-22372423f630 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:51:21.480955 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-8c6e20fd-f6f9-4cfb-8d89-22372423f630 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:21.481411 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-8c6e20fd-f6f9-4cfb-8d89-22372423f630 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:21.482443 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-8c6e20fd-f6f9-4cfb-8d89-22372423f630 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:21.483263 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-8c6e20fd-f6f9-4cfb-8d89-22372423f630 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:21.714831 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-45e23b01-6152-4291-8d02-9cc191d87560 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:51:21.718488 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-45e23b01-6152-4291-8d02-9cc191d87560 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] [instance: 7855c920-9df4-495a-9733-78fe42b1705d] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:51:21.724236 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-45e23b01-6152-4291-8d02-9cc191d87560 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:21.724689 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-45e23b01-6152-4291-8d02-9cc191d87560 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:21.725471 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-45e23b01-6152-4291-8d02-9cc191d87560 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:21.727235 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-45e23b01-6152-4291-8d02-9cc191d87560 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:21.741394 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-8c6e20fd-f6f9-4cfb-8d89-22372423f630 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:21.755214 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-8c6e20fd-f6f9-4cfb-8d89-22372423f630 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:21.756830 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-8c6e20fd-f6f9-4cfb-8d89-22372423f630 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:21.758017 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-8c6e20fd-f6f9-4cfb-8d89-22372423f630 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9" status: 200 len: 1723 microversion: 2.20 time: 0.289676 May 12 14:51:21.758739 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 208/439] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:51:21 2022] GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9 => generated 1723 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:51:22.006713 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-45e23b01-6152-4291-8d02-9cc191d87560 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6d3863350647cdb3091c1006d56c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfe8d8bce3f496d9162c7f9c8727273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:22.016174 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-45e23b01-6152-4291-8d02-9cc191d87560 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] 10.222.0.49 "GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d" status: 200 len: 1443 microversion: 2.1 time: 0.304917 May 12 14:51:22.024354 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 232/440] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:51:21 2022] GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d => generated 1443 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:51:22.035985 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-a70828a5-8281-4f2e-97c0-12a994990c10 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:51:22.036609 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-a70828a5-8281-4f2e-97c0-12a994990c10 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] [instance: 7855c920-9df4-495a-9733-78fe42b1705d] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:51:22.044054 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-a70828a5-8281-4f2e-97c0-12a994990c10 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:22.044811 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-a70828a5-8281-4f2e-97c0-12a994990c10 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:22.045780 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-a70828a5-8281-4f2e-97c0-12a994990c10 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:22.046391 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-a70828a5-8281-4f2e-97c0-12a994990c10 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:22.256311 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-a70828a5-8281-4f2e-97c0-12a994990c10 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6d3863350647cdb3091c1006d56c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfe8d8bce3f496d9162c7f9c8727273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:22.265397 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-a70828a5-8281-4f2e-97c0-12a994990c10 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] 10.222.0.49 "GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d" status: 200 len: 1443 microversion: 2.1 time: 0.232933 May 12 14:51:22.279005 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 209/441] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:51:22 2022] GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d => generated 1443 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:51:22.388840 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-c197e832-b919-4bf9-b7d6-36a2ef7bc7b7 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:51:22.390185 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-c197e832-b919-4bf9-b7d6-36a2ef7bc7b7 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] [instance: 6809f21a-9df9-499a-aec9-c628d50b64e3] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:51:22.400623 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-c197e832-b919-4bf9-b7d6-36a2ef7bc7b7 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:22.401376 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-c197e832-b919-4bf9-b7d6-36a2ef7bc7b7 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:22.402382 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-c197e832-b919-4bf9-b7d6-36a2ef7bc7b7 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:22.403097 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-c197e832-b919-4bf9-b7d6-36a2ef7bc7b7 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:22.629086 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-c197e832-b919-4bf9-b7d6-36a2ef7bc7b7 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab371128e42444f49bc63661feaf7cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ed089c81294b4981046ede5ed951bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:22.638264 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-c197e832-b919-4bf9-b7d6-36a2ef7bc7b7 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] 10.222.0.49 "GET /compute/v2.1/servers/6809f21a-9df9-499a-aec9-c628d50b64e3" status: 200 len: 1319 microversion: 2.1 time: 0.253243 May 12 14:51:22.647365 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 233/442] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:51:22 2022] GET /compute/v2.1/servers/6809f21a-9df9-499a-aec9-c628d50b64e3 => generated 1319 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:51:22.776960 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-732ce747-aa54-4994-b1cd-5b25883a8b03 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:51:22.777993 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-732ce747-aa54-4994-b1cd-5b25883a8b03 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:51:22.785978 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-732ce747-aa54-4994-b1cd-5b25883a8b03 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:22.786492 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-732ce747-aa54-4994-b1cd-5b25883a8b03 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:22.787435 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-732ce747-aa54-4994-b1cd-5b25883a8b03 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:22.788096 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-732ce747-aa54-4994-b1cd-5b25883a8b03 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:23.078957 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-732ce747-aa54-4994-b1cd-5b25883a8b03 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:23.090955 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-732ce747-aa54-4994-b1cd-5b25883a8b03 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:23.092495 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-732ce747-aa54-4994-b1cd-5b25883a8b03 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:23.093675 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-732ce747-aa54-4994-b1cd-5b25883a8b03 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9" status: 200 len: 1723 microversion: 2.20 time: 0.321373 May 12 14:51:23.094243 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 210/443] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:51:22 2022] GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9 => generated 1723 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:51:23.655949 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-1d49572e-fc19-402b-bfa8-fea1a0dfeebd tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:51:23.656857 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-1d49572e-fc19-402b-bfa8-fea1a0dfeebd tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] [instance: 6809f21a-9df9-499a-aec9-c628d50b64e3] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:51:23.664439 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-1d49572e-fc19-402b-bfa8-fea1a0dfeebd tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:23.664878 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-1d49572e-fc19-402b-bfa8-fea1a0dfeebd tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:23.665648 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-1d49572e-fc19-402b-bfa8-fea1a0dfeebd tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:23.666078 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-1d49572e-fc19-402b-bfa8-fea1a0dfeebd tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:23.899848 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-1d49572e-fc19-402b-bfa8-fea1a0dfeebd tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab371128e42444f49bc63661feaf7cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ed089c81294b4981046ede5ed951bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:23.910520 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-1d49572e-fc19-402b-bfa8-fea1a0dfeebd tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] 10.222.0.49 "GET /compute/v2.1/servers/6809f21a-9df9-499a-aec9-c628d50b64e3" status: 200 len: 1319 microversion: 2.1 time: 0.258235 May 12 14:51:23.911395 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 234/444] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:51:23 2022] GET /compute/v2.1/servers/6809f21a-9df9-499a-aec9-c628d50b64e3 => generated 1319 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:51:24.111651 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-6227178d-64d1-40b1-a498-2c0dab8d1a0a tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:51:24.112265 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-6227178d-64d1-40b1-a498-2c0dab8d1a0a tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:51:24.121917 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-6227178d-64d1-40b1-a498-2c0dab8d1a0a tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:24.124609 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-6227178d-64d1-40b1-a498-2c0dab8d1a0a tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:24.126398 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-6227178d-64d1-40b1-a498-2c0dab8d1a0a tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:24.127075 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-6227178d-64d1-40b1-a498-2c0dab8d1a0a tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:24.446348 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-6227178d-64d1-40b1-a498-2c0dab8d1a0a tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:24.455818 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-6227178d-64d1-40b1-a498-2c0dab8d1a0a tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:24.457612 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-6227178d-64d1-40b1-a498-2c0dab8d1a0a tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:24.459108 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-6227178d-64d1-40b1-a498-2c0dab8d1a0a tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9" status: 200 len: 1723 microversion: 2.20 time: 0.350847 May 12 14:51:24.470240 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 211/445] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:51:24 2022] GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9 => generated 1723 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:51:24.927540 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-512e3e49-d1df-4ebf-a2f1-b5d72cecc2ff tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:51:24.928220 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-512e3e49-d1df-4ebf-a2f1-b5d72cecc2ff tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] [instance: 6809f21a-9df9-499a-aec9-c628d50b64e3] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:51:24.937924 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-512e3e49-d1df-4ebf-a2f1-b5d72cecc2ff tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:24.938720 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-512e3e49-d1df-4ebf-a2f1-b5d72cecc2ff tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:24.939841 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-512e3e49-d1df-4ebf-a2f1-b5d72cecc2ff tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:24.940487 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-512e3e49-d1df-4ebf-a2f1-b5d72cecc2ff tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:25.172274 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-512e3e49-d1df-4ebf-a2f1-b5d72cecc2ff tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab371128e42444f49bc63661feaf7cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ed089c81294b4981046ede5ed951bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:25.181935 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-512e3e49-d1df-4ebf-a2f1-b5d72cecc2ff tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] 10.222.0.49 "GET /compute/v2.1/servers/6809f21a-9df9-499a-aec9-c628d50b64e3" status: 200 len: 1319 microversion: 2.1 time: 0.257978 May 12 14:51:25.183274 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 235/446] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:51:24 2022] GET /compute/v2.1/servers/6809f21a-9df9-499a-aec9-c628d50b64e3 => generated 1319 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:51:25.480110 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-5668e393-e715-4578-8877-97e869ad86ae tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:51:25.481509 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-5668e393-e715-4578-8877-97e869ad86ae tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:51:25.491530 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-5668e393-e715-4578-8877-97e869ad86ae tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:25.492391 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-5668e393-e715-4578-8877-97e869ad86ae tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:25.494139 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-5668e393-e715-4578-8877-97e869ad86ae tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:25.494783 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-5668e393-e715-4578-8877-97e869ad86ae tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:25.947206 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-5668e393-e715-4578-8877-97e869ad86ae tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:25.968040 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-5668e393-e715-4578-8877-97e869ad86ae tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:25.971617 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-5668e393-e715-4578-8877-97e869ad86ae tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:25.972746 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-5668e393-e715-4578-8877-97e869ad86ae tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9" status: 200 len: 1723 microversion: 2.20 time: 0.498468 May 12 14:51:25.985000 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 212/447] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:51:25 2022] GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9 => generated 1723 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:51:26.217025 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-13cfd8f3-fca8-41df-981b-99f06e47d87a tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:51:26.218494 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-13cfd8f3-fca8-41df-981b-99f06e47d87a tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] [instance: 6809f21a-9df9-499a-aec9-c628d50b64e3] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:51:26.229112 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-13cfd8f3-fca8-41df-981b-99f06e47d87a tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:26.229554 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-13cfd8f3-fca8-41df-981b-99f06e47d87a tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:26.230331 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-13cfd8f3-fca8-41df-981b-99f06e47d87a tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:26.230757 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-13cfd8f3-fca8-41df-981b-99f06e47d87a tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:26.503792 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-13cfd8f3-fca8-41df-981b-99f06e47d87a tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab371128e42444f49bc63661feaf7cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ed089c81294b4981046ede5ed951bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:26.514203 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-13cfd8f3-fca8-41df-981b-99f06e47d87a tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] 10.222.0.49 "GET /compute/v2.1/servers/6809f21a-9df9-499a-aec9-c628d50b64e3" status: 200 len: 1319 microversion: 2.1 time: 0.301300 May 12 14:51:26.516358 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 236/448] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:51:26 2022] GET /compute/v2.1/servers/6809f21a-9df9-499a-aec9-c628d50b64e3 => generated 1319 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:51:26.551278 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [req-5fe86f03-1f1a-4113-b61b-eb0b7dba441a req-32e6b5c3-b475-4ce6-a6b0-6657d5b43eec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7855c920-9df4-495a-9733-78fe42b1705d", "tag": "71d6ba38-f010-4812-ade3-cd0173c05466"}]} {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:51:26.552837 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:51:26.552837 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: warnings.warn(msg) May 12 14:51:26.561155 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [req-5fe86f03-1f1a-4113-b61b-eb0b7dba441a req-32e6b5c3-b475-4ce6-a6b0-6657d5b43eec service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:26.561596 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [req-5fe86f03-1f1a-4113-b61b-eb0b7dba441a req-32e6b5c3-b475-4ce6-a6b0-6657d5b43eec service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:26.578865 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.compute.server_external_events [req-5fe86f03-1f1a-4113-b61b-eb0b7dba441a req-32e6b5c3-b475-4ce6-a6b0-6657d5b43eec service nova] Creating event network-changed:71d6ba38-f010-4812-ade3-cd0173c05466 for instance 7855c920-9df4-495a-9733-78fe42b1705d on hv-cinder-83118 May 12 14:51:26.584493 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [req-5fe86f03-1f1a-4113-b61b-eb0b7dba441a req-32e6b5c3-b475-4ce6-a6b0-6657d5b43eec service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036541 May 12 14:51:26.585854 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 213/449] 10.222.0.49 () {64 vars in 1317 bytes} [Thu May 12 14:51:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:51:26.992455 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-ab5e7aed-9e57-4494-882a-46afe685853d tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:51:26.993334 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-ab5e7aed-9e57-4494-882a-46afe685853d tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:51:27.001214 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-ab5e7aed-9e57-4494-882a-46afe685853d tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:27.003179 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-ab5e7aed-9e57-4494-882a-46afe685853d tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:27.003179 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-ab5e7aed-9e57-4494-882a-46afe685853d tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:27.003179 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-ab5e7aed-9e57-4494-882a-46afe685853d tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:27.320432 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-ab5e7aed-9e57-4494-882a-46afe685853d tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:27.336931 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-ab5e7aed-9e57-4494-882a-46afe685853d tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:27.339177 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-ab5e7aed-9e57-4494-882a-46afe685853d tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:27.340837 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-ab5e7aed-9e57-4494-882a-46afe685853d tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9" status: 200 len: 1723 microversion: 2.20 time: 0.352869 May 12 14:51:27.351366 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 237/450] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:51:26 2022] GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9 => generated 1723 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:51:27.533232 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-4daf8317-a0c0-464f-8dd9-7c2174d08ba4 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:51:27.534012 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-4daf8317-a0c0-464f-8dd9-7c2174d08ba4 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] [instance: 6809f21a-9df9-499a-aec9-c628d50b64e3] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:51:27.565755 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-4daf8317-a0c0-464f-8dd9-7c2174d08ba4 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:27.568373 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-4daf8317-a0c0-464f-8dd9-7c2174d08ba4 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:27.572377 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-4daf8317-a0c0-464f-8dd9-7c2174d08ba4 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:27.572956 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-4daf8317-a0c0-464f-8dd9-7c2174d08ba4 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:28.033327 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-4daf8317-a0c0-464f-8dd9-7c2174d08ba4 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab371128e42444f49bc63661feaf7cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ed089c81294b4981046ede5ed951bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:28.045571 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-4daf8317-a0c0-464f-8dd9-7c2174d08ba4 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] 10.222.0.49 "GET /compute/v2.1/servers/6809f21a-9df9-499a-aec9-c628d50b64e3" status: 200 len: 1319 microversion: 2.1 time: 0.517057 May 12 14:51:28.046534 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 214/451] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:51:27 2022] GET /compute/v2.1/servers/6809f21a-9df9-499a-aec9-c628d50b64e3 => generated 1319 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:51:28.359039 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-ed08de5f-3183-4679-b4f6-9b400c03aa97 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:51:28.360392 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-ed08de5f-3183-4679-b4f6-9b400c03aa97 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:51:28.368331 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-ed08de5f-3183-4679-b4f6-9b400c03aa97 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:28.369024 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-ed08de5f-3183-4679-b4f6-9b400c03aa97 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:28.370094 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-ed08de5f-3183-4679-b4f6-9b400c03aa97 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:28.370522 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-ed08de5f-3183-4679-b4f6-9b400c03aa97 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:28.594789 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-ed08de5f-3183-4679-b4f6-9b400c03aa97 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:28.604330 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-ed08de5f-3183-4679-b4f6-9b400c03aa97 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:28.606070 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-ed08de5f-3183-4679-b4f6-9b400c03aa97 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:28.607235 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-ed08de5f-3183-4679-b4f6-9b400c03aa97 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9" status: 200 len: 1723 microversion: 2.20 time: 0.251909 May 12 14:51:28.608157 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 238/452] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:51:28 2022] GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9 => generated 1723 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:51:29.062784 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-dd708730-e35a-4ea8-89fe-d2cd7379ef88 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:51:29.063641 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-dd708730-e35a-4ea8-89fe-d2cd7379ef88 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] [instance: 6809f21a-9df9-499a-aec9-c628d50b64e3] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:51:29.071997 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-dd708730-e35a-4ea8-89fe-d2cd7379ef88 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:29.072449 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-dd708730-e35a-4ea8-89fe-d2cd7379ef88 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:29.073225 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-dd708730-e35a-4ea8-89fe-d2cd7379ef88 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:29.073655 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-dd708730-e35a-4ea8-89fe-d2cd7379ef88 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:29.286344 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-dd708730-e35a-4ea8-89fe-d2cd7379ef88 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab371128e42444f49bc63661feaf7cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ed089c81294b4981046ede5ed951bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:29.295725 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-dd708730-e35a-4ea8-89fe-d2cd7379ef88 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] 10.222.0.49 "GET /compute/v2.1/servers/6809f21a-9df9-499a-aec9-c628d50b64e3" status: 200 len: 1319 microversion: 2.1 time: 0.236591 May 12 14:51:29.296307 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 215/453] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:51:29 2022] GET /compute/v2.1/servers/6809f21a-9df9-499a-aec9-c628d50b64e3 => generated 1319 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:51:29.529020 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [req-fa6da93e-63fa-4b41-9ecf-071eb3085b38 req-a5c44ec7-4abd-4a90-b439-daceb208ed85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6809f21a-9df9-499a-aec9-c628d50b64e3", "name": "network-vif-plugged", "status": "completed", "tag": "89a9ff10-8343-460a-9e65-0158c87f5841"}]} {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:51:29.530801 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:51:29.530801 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: warnings.warn(msg) May 12 14:51:29.540076 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [req-fa6da93e-63fa-4b41-9ecf-071eb3085b38 req-a5c44ec7-4abd-4a90-b439-daceb208ed85 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:29.540799 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [req-fa6da93e-63fa-4b41-9ecf-071eb3085b38 req-a5c44ec7-4abd-4a90-b439-daceb208ed85 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:29.559234 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.compute.server_external_events [req-fa6da93e-63fa-4b41-9ecf-071eb3085b38 req-a5c44ec7-4abd-4a90-b439-daceb208ed85 service nova] Creating event network-vif-plugged:89a9ff10-8343-460a-9e65-0158c87f5841 for instance 6809f21a-9df9-499a-aec9-c628d50b64e3 on hv-cinder-83118 May 12 14:51:29.564581 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [req-fa6da93e-63fa-4b41-9ecf-071eb3085b38 req-a5c44ec7-4abd-4a90-b439-daceb208ed85 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039745 May 12 14:51:29.565459 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 239/454] 10.222.0.49 () {64 vars in 1317 bytes} [Thu May 12 14:51:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:51:29.626030 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-ea39b989-46b3-443a-8a9b-6f07f83c45c5 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:51:29.626753 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-ea39b989-46b3-443a-8a9b-6f07f83c45c5 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:51:29.635444 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-ea39b989-46b3-443a-8a9b-6f07f83c45c5 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:29.636191 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-ea39b989-46b3-443a-8a9b-6f07f83c45c5 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:29.636859 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-ea39b989-46b3-443a-8a9b-6f07f83c45c5 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:29.637360 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-ea39b989-46b3-443a-8a9b-6f07f83c45c5 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:29.878721 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-ea39b989-46b3-443a-8a9b-6f07f83c45c5 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:29.889072 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-ea39b989-46b3-443a-8a9b-6f07f83c45c5 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:29.890672 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-ea39b989-46b3-443a-8a9b-6f07f83c45c5 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:29.891977 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-ea39b989-46b3-443a-8a9b-6f07f83c45c5 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9" status: 200 len: 1723 microversion: 2.20 time: 0.270191 May 12 14:51:29.892542 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 216/455] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:51:29 2022] GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9 => generated 1723 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:51:30.317847 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-fa4668ec-476d-4195-868d-b24ce0858023 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:51:30.318582 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-fa4668ec-476d-4195-868d-b24ce0858023 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] [instance: 6809f21a-9df9-499a-aec9-c628d50b64e3] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:51:30.327342 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-fa4668ec-476d-4195-868d-b24ce0858023 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:30.327883 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-fa4668ec-476d-4195-868d-b24ce0858023 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:30.329200 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-fa4668ec-476d-4195-868d-b24ce0858023 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:30.329200 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-fa4668ec-476d-4195-868d-b24ce0858023 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:30.566023 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-fa4668ec-476d-4195-868d-b24ce0858023 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab371128e42444f49bc63661feaf7cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ed089c81294b4981046ede5ed951bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:30.574140 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-fa4668ec-476d-4195-868d-b24ce0858023 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] 10.222.0.49 "GET /compute/v2.1/servers/6809f21a-9df9-499a-aec9-c628d50b64e3" status: 200 len: 1319 microversion: 2.1 time: 0.261845 May 12 14:51:30.574953 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 240/456] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:51:30 2022] GET /compute/v2.1/servers/6809f21a-9df9-499a-aec9-c628d50b64e3 => generated 1319 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:51:30.911864 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-a82fd860-cab3-40c3-a9f0-6ab333d716f8 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:51:30.912460 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-a82fd860-cab3-40c3-a9f0-6ab333d716f8 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:51:30.920425 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-a82fd860-cab3-40c3-a9f0-6ab333d716f8 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:30.921109 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-a82fd860-cab3-40c3-a9f0-6ab333d716f8 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:30.922070 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-a82fd860-cab3-40c3-a9f0-6ab333d716f8 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:30.922512 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-a82fd860-cab3-40c3-a9f0-6ab333d716f8 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:31.189152 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-a82fd860-cab3-40c3-a9f0-6ab333d716f8 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:31.203326 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-a82fd860-cab3-40c3-a9f0-6ab333d716f8 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:31.205401 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-a82fd860-cab3-40c3-a9f0-6ab333d716f8 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:31.207607 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-a82fd860-cab3-40c3-a9f0-6ab333d716f8 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9" status: 200 len: 1723 microversion: 2.20 time: 0.299388 May 12 14:51:31.208418 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 217/457] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:51:30 2022] GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9 => generated 1723 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:51:31.590324 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-cb38a0fe-7f72-4255-964f-dc2a5f24e7f6 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:51:31.591604 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-cb38a0fe-7f72-4255-964f-dc2a5f24e7f6 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] [instance: 6809f21a-9df9-499a-aec9-c628d50b64e3] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:51:31.599105 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-cb38a0fe-7f72-4255-964f-dc2a5f24e7f6 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:31.599795 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-cb38a0fe-7f72-4255-964f-dc2a5f24e7f6 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:31.600653 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-cb38a0fe-7f72-4255-964f-dc2a5f24e7f6 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:31.601096 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-cb38a0fe-7f72-4255-964f-dc2a5f24e7f6 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:31.806329 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-cb38a0fe-7f72-4255-964f-dc2a5f24e7f6 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab371128e42444f49bc63661feaf7cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ed089c81294b4981046ede5ed951bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:31.815349 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-cb38a0fe-7f72-4255-964f-dc2a5f24e7f6 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] 10.222.0.49 "GET /compute/v2.1/servers/6809f21a-9df9-499a-aec9-c628d50b64e3" status: 200 len: 1319 microversion: 2.1 time: 0.228472 May 12 14:51:31.816419 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 241/458] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:51:31 2022] GET /compute/v2.1/servers/6809f21a-9df9-499a-aec9-c628d50b64e3 => generated 1319 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:51:32.230063 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-cb874d2d-9f86-4771-a260-695b970be686 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:51:32.230680 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-cb874d2d-9f86-4771-a260-695b970be686 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:51:32.238599 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-cb874d2d-9f86-4771-a260-695b970be686 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:32.239083 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-cb874d2d-9f86-4771-a260-695b970be686 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:32.240088 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-cb874d2d-9f86-4771-a260-695b970be686 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:32.240719 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-cb874d2d-9f86-4771-a260-695b970be686 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:32.447166 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-cb874d2d-9f86-4771-a260-695b970be686 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:32.457706 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-cb874d2d-9f86-4771-a260-695b970be686 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:32.459238 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-cb874d2d-9f86-4771-a260-695b970be686 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:32.461026 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-cb874d2d-9f86-4771-a260-695b970be686 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9" status: 200 len: 1744 microversion: 2.20 time: 0.235556 May 12 14:51:32.461779 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 218/459] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:51:32 2022] GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9 => generated 1744 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:51:32.831307 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-eeb8358f-9d77-4ee9-a12d-267e4db884ce tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:51:32.832116 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-eeb8358f-9d77-4ee9-a12d-267e4db884ce tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] [instance: 6809f21a-9df9-499a-aec9-c628d50b64e3] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:51:32.840314 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-eeb8358f-9d77-4ee9-a12d-267e4db884ce tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:32.840992 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-eeb8358f-9d77-4ee9-a12d-267e4db884ce tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:32.841957 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-eeb8358f-9d77-4ee9-a12d-267e4db884ce tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:32.842550 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-eeb8358f-9d77-4ee9-a12d-267e4db884ce tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:33.048607 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-eeb8358f-9d77-4ee9-a12d-267e4db884ce tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab371128e42444f49bc63661feaf7cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ed089c81294b4981046ede5ed951bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:33.058432 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-eeb8358f-9d77-4ee9-a12d-267e4db884ce tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] 10.222.0.49 "GET /compute/v2.1/servers/6809f21a-9df9-499a-aec9-c628d50b64e3" status: 200 len: 1508 microversion: 2.1 time: 0.230770 May 12 14:51:33.059337 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 242/460] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:51:32 2022] GET /compute/v2.1/servers/6809f21a-9df9-499a-aec9-c628d50b64e3 => generated 1508 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:51:33.076238 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-40988d77-b9f7-493c-ba18-32a5f247a7ef tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "df5d3548-c95e-4ce3-af4f-a0060a2fbf7e", "device": "/dev/sdb"}} {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:51:33.078120 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-40988d77-b9f7-493c-ba18-32a5f247a7ef tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] [instance: 6809f21a-9df9-499a-aec9-c628d50b64e3] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:51:33.088238 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-40988d77-b9f7-493c-ba18-32a5f247a7ef tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:33.088704 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-40988d77-b9f7-493c-ba18-32a5f247a7ef tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:33.089578 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-40988d77-b9f7-493c-ba18-32a5f247a7ef tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:33.090093 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-40988d77-b9f7-493c-ba18-32a5f247a7ef tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:33.481650 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-1c85c6d3-9aee-4fa9-85c5-b494f06214f4 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:51:33.481650 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-1c85c6d3-9aee-4fa9-85c5-b494f06214f4 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:51:33.500071 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-1c85c6d3-9aee-4fa9-85c5-b494f06214f4 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:33.500071 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-1c85c6d3-9aee-4fa9-85c5-b494f06214f4 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:33.500071 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-1c85c6d3-9aee-4fa9-85c5-b494f06214f4 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:33.500071 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-1c85c6d3-9aee-4fa9-85c5-b494f06214f4 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:33.707263 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-1c85c6d3-9aee-4fa9-85c5-b494f06214f4 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:33.716127 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-1c85c6d3-9aee-4fa9-85c5-b494f06214f4 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:33.717714 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-1c85c6d3-9aee-4fa9-85c5-b494f06214f4 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:33.718941 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-1c85c6d3-9aee-4fa9-85c5-b494f06214f4 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9" status: 200 len: 1744 microversion: 2.20 time: 0.243147 May 12 14:51:33.719595 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 243/461] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:51:33 2022] GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9 => generated 1744 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 14:51:34.339952 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-40988d77-b9f7-493c-ba18-32a5f247a7ef tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] 10.222.0.49 "POST /compute/v2.1/servers/6809f21a-9df9-499a-aec9-c628d50b64e3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.266859 May 12 14:51:34.341576 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 219/462] 10.222.0.49 () {60 vars in 1322 bytes} [Thu May 12 14:51:33 2022] POST /compute/v2.1/servers/6809f21a-9df9-499a-aec9-c628d50b64e3/os-volume_attachments => generated 194 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 14:51:34.738789 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-982d8708-4774-473c-a3a8-0cda1c9d1b34 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:51:34.740715 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-982d8708-4774-473c-a3a8-0cda1c9d1b34 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:51:34.748443 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-982d8708-4774-473c-a3a8-0cda1c9d1b34 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:34.748896 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-982d8708-4774-473c-a3a8-0cda1c9d1b34 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:34.749698 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-982d8708-4774-473c-a3a8-0cda1c9d1b34 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:34.750130 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-982d8708-4774-473c-a3a8-0cda1c9d1b34 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:34.955189 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-982d8708-4774-473c-a3a8-0cda1c9d1b34 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:34.964153 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-982d8708-4774-473c-a3a8-0cda1c9d1b34 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:34.966670 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-982d8708-4774-473c-a3a8-0cda1c9d1b34 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:34.967972 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-982d8708-4774-473c-a3a8-0cda1c9d1b34 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9" status: 200 len: 1739 microversion: 2.20 time: 0.233161 May 12 14:51:34.968949 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 244/463] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:51:34 2022] GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9 => generated 1739 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:51:35.355154 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [req-69557b2d-5f96-4177-9f9b-f0ba51aa0534 req-64e14334-2e6e-4b9c-8649-648d6a829b10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9", "name": "network-vif-plugged", "status": "completed", "tag": "892fd785-17e4-4442-9f7d-2e5d18b22e9f"}]} {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:51:35.357216 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:51:35.357216 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: warnings.warn(msg) May 12 14:51:35.366730 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [req-69557b2d-5f96-4177-9f9b-f0ba51aa0534 req-64e14334-2e6e-4b9c-8649-648d6a829b10 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:35.367196 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [req-69557b2d-5f96-4177-9f9b-f0ba51aa0534 req-64e14334-2e6e-4b9c-8649-648d6a829b10 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:35.384474 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.compute.server_external_events [req-69557b2d-5f96-4177-9f9b-f0ba51aa0534 req-64e14334-2e6e-4b9c-8649-648d6a829b10 service nova] Creating event network-vif-plugged:892fd785-17e4-4442-9f7d-2e5d18b22e9f for instance a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9 on hv-cinder-83118 May 12 14:51:35.388963 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [req-69557b2d-5f96-4177-9f9b-f0ba51aa0534 req-64e14334-2e6e-4b9c-8649-648d6a829b10 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038755 May 12 14:51:35.389596 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 220/464] 10.222.0.49 () {64 vars in 1317 bytes} [Thu May 12 14:51:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:51:35.989179 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-946c4fdb-141c-4344-9b03-497d69df78b4 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:51:35.989959 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-946c4fdb-141c-4344-9b03-497d69df78b4 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:51:35.999619 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-946c4fdb-141c-4344-9b03-497d69df78b4 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:36.000395 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-946c4fdb-141c-4344-9b03-497d69df78b4 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:36.001218 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-946c4fdb-141c-4344-9b03-497d69df78b4 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:36.001642 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-946c4fdb-141c-4344-9b03-497d69df78b4 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:36.260712 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-946c4fdb-141c-4344-9b03-497d69df78b4 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:36.270853 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-946c4fdb-141c-4344-9b03-497d69df78b4 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:36.278405 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-946c4fdb-141c-4344-9b03-497d69df78b4 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:36.279961 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-946c4fdb-141c-4344-9b03-497d69df78b4 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9" status: 200 len: 1739 microversion: 2.20 time: 0.296138 May 12 14:51:36.280712 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 245/465] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:51:35 2022] GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9 => generated 1739 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:51:37.305218 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-06f638d4-86bb-4367-8276-15c0a2692d08 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:51:37.305979 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-06f638d4-86bb-4367-8276-15c0a2692d08 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:51:37.314364 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-06f638d4-86bb-4367-8276-15c0a2692d08 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:37.315303 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-06f638d4-86bb-4367-8276-15c0a2692d08 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:37.317998 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-06f638d4-86bb-4367-8276-15c0a2692d08 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:37.318550 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-06f638d4-86bb-4367-8276-15c0a2692d08 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:37.630886 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-06f638d4-86bb-4367-8276-15c0a2692d08 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:37.641831 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-06f638d4-86bb-4367-8276-15c0a2692d08 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:37.643842 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-06f638d4-86bb-4367-8276-15c0a2692d08 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:37.645633 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-06f638d4-86bb-4367-8276-15c0a2692d08 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9" status: 200 len: 1739 microversion: 2.20 time: 0.346243 May 12 14:51:37.668083 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 221/466] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:51:37 2022] GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9 => generated 1739 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:51:38.676427 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-65413a4c-7780-4344-a035-9cf59c40d1bf tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:51:38.677156 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-65413a4c-7780-4344-a035-9cf59c40d1bf tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:51:38.684462 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-65413a4c-7780-4344-a035-9cf59c40d1bf tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:38.684907 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-65413a4c-7780-4344-a035-9cf59c40d1bf tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:38.685666 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-65413a4c-7780-4344-a035-9cf59c40d1bf tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:38.686098 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-65413a4c-7780-4344-a035-9cf59c40d1bf tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:38.946917 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-65413a4c-7780-4344-a035-9cf59c40d1bf tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:38.962325 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-65413a4c-7780-4344-a035-9cf59c40d1bf tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:38.963940 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-65413a4c-7780-4344-a035-9cf59c40d1bf tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:38.965665 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-65413a4c-7780-4344-a035-9cf59c40d1bf tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9" status: 200 len: 1739 microversion: 2.20 time: 0.292921 May 12 14:51:38.966197 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 246/467] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:51:38 2022] GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9 => generated 1739 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:51:39.984059 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-9757f495-e1de-444b-9ad7-eaf1fcfb2e73 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:51:39.984608 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-9757f495-e1de-444b-9ad7-eaf1fcfb2e73 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:51:39.993137 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-9757f495-e1de-444b-9ad7-eaf1fcfb2e73 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:39.993594 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-9757f495-e1de-444b-9ad7-eaf1fcfb2e73 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:39.994575 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-9757f495-e1de-444b-9ad7-eaf1fcfb2e73 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:39.995346 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-9757f495-e1de-444b-9ad7-eaf1fcfb2e73 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:40.208262 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-9757f495-e1de-444b-9ad7-eaf1fcfb2e73 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:40.218531 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-9757f495-e1de-444b-9ad7-eaf1fcfb2e73 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:40.220173 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-9757f495-e1de-444b-9ad7-eaf1fcfb2e73 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:40.221437 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-9757f495-e1de-444b-9ad7-eaf1fcfb2e73 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9" status: 200 len: 1739 microversion: 2.20 time: 0.241469 May 12 14:51:40.232370 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 222/468] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:51:39 2022] GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9 => generated 1739 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:51:41.240098 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-1ee30851-f8b8-4bc7-8ae6-ed6f5df71285 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:51:41.241607 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-1ee30851-f8b8-4bc7-8ae6-ed6f5df71285 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:51:41.251867 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-1ee30851-f8b8-4bc7-8ae6-ed6f5df71285 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:41.252779 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-1ee30851-f8b8-4bc7-8ae6-ed6f5df71285 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:41.253935 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-1ee30851-f8b8-4bc7-8ae6-ed6f5df71285 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:41.254590 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-1ee30851-f8b8-4bc7-8ae6-ed6f5df71285 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:41.504700 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-1ee30851-f8b8-4bc7-8ae6-ed6f5df71285 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:41.515584 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-1ee30851-f8b8-4bc7-8ae6-ed6f5df71285 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:41.517486 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-1ee30851-f8b8-4bc7-8ae6-ed6f5df71285 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:41.518751 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-1ee30851-f8b8-4bc7-8ae6-ed6f5df71285 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9" status: 200 len: 1739 microversion: 2.20 time: 0.282438 May 12 14:51:41.519312 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 247/469] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:51:41 2022] GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9 => generated 1739 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:51:42.541380 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-d86ff9a1-e00c-4641-a3eb-9f1285bfefc9 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:51:42.541912 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-d86ff9a1-e00c-4641-a3eb-9f1285bfefc9 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:51:42.558114 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-d86ff9a1-e00c-4641-a3eb-9f1285bfefc9 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:42.559126 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-d86ff9a1-e00c-4641-a3eb-9f1285bfefc9 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:42.568166 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-d86ff9a1-e00c-4641-a3eb-9f1285bfefc9 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:42.568166 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-d86ff9a1-e00c-4641-a3eb-9f1285bfefc9 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:42.815639 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-d86ff9a1-e00c-4641-a3eb-9f1285bfefc9 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:42.827559 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-d86ff9a1-e00c-4641-a3eb-9f1285bfefc9 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:42.829121 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-d86ff9a1-e00c-4641-a3eb-9f1285bfefc9 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:42.830322 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-d86ff9a1-e00c-4641-a3eb-9f1285bfefc9 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9" status: 200 len: 1739 microversion: 2.20 time: 0.293529 May 12 14:51:42.842727 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 223/470] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:51:42 2022] GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9 => generated 1739 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:51:43.850046 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-0291f14a-7f79-4f97-8fcc-5d79a7ef6870 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:51:43.850698 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-0291f14a-7f79-4f97-8fcc-5d79a7ef6870 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:51:43.860180 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-0291f14a-7f79-4f97-8fcc-5d79a7ef6870 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:43.860908 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-0291f14a-7f79-4f97-8fcc-5d79a7ef6870 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:43.861978 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-0291f14a-7f79-4f97-8fcc-5d79a7ef6870 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:43.862642 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-0291f14a-7f79-4f97-8fcc-5d79a7ef6870 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:44.109043 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-0291f14a-7f79-4f97-8fcc-5d79a7ef6870 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:44.126459 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-0291f14a-7f79-4f97-8fcc-5d79a7ef6870 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:44.128498 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-0291f14a-7f79-4f97-8fcc-5d79a7ef6870 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:44.129799 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-0291f14a-7f79-4f97-8fcc-5d79a7ef6870 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9" status: 200 len: 1739 microversion: 2.20 time: 0.283803 May 12 14:51:44.146354 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 248/471] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:51:43 2022] GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9 => generated 1739 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:51:45.148068 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-148cfb82-7408-4b00-bb1d-dac72edaa1b1 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:51:45.193876 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-148cfb82-7408-4b00-bb1d-dac72edaa1b1 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:51:45.193876 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-148cfb82-7408-4b00-bb1d-dac72edaa1b1 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:45.193876 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-148cfb82-7408-4b00-bb1d-dac72edaa1b1 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:45.193876 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-148cfb82-7408-4b00-bb1d-dac72edaa1b1 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:45.195048 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-148cfb82-7408-4b00-bb1d-dac72edaa1b1 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:45.361877 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-148cfb82-7408-4b00-bb1d-dac72edaa1b1 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:45.371496 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-148cfb82-7408-4b00-bb1d-dac72edaa1b1 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:45.372927 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-148cfb82-7408-4b00-bb1d-dac72edaa1b1 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:45.374092 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-148cfb82-7408-4b00-bb1d-dac72edaa1b1 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9" status: 200 len: 1739 microversion: 2.20 time: 0.229875 May 12 14:51:45.374638 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 224/472] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:51:45 2022] GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9 => generated 1739 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:51:46.392649 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-83d3f83a-e82c-4b35-a048-7ef086048e78 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:51:46.394298 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-83d3f83a-e82c-4b35-a048-7ef086048e78 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:51:46.403022 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-83d3f83a-e82c-4b35-a048-7ef086048e78 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:46.403604 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-83d3f83a-e82c-4b35-a048-7ef086048e78 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:46.404763 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-83d3f83a-e82c-4b35-a048-7ef086048e78 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:46.405437 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-83d3f83a-e82c-4b35-a048-7ef086048e78 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:46.558077 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-5ce8cc2f-f174-42ae-a9b0-db2de683951d tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:51:46.558617 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-5ce8cc2f-f174-42ae-a9b0-db2de683951d tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 84ccb759-1bc2-4810-8e46-e34c0c29a0d5] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:51:46.565923 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-5ce8cc2f-f174-42ae-a9b0-db2de683951d tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:46.566488 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-5ce8cc2f-f174-42ae-a9b0-db2de683951d tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:46.567302 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-5ce8cc2f-f174-42ae-a9b0-db2de683951d tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:46.567740 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-5ce8cc2f-f174-42ae-a9b0-db2de683951d tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:46.608557 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-83d3f83a-e82c-4b35-a048-7ef086048e78 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:46.617874 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-83d3f83a-e82c-4b35-a048-7ef086048e78 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:46.619454 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-83d3f83a-e82c-4b35-a048-7ef086048e78 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:46.620580 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-83d3f83a-e82c-4b35-a048-7ef086048e78 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9" status: 200 len: 1739 microversion: 2.20 time: 0.231977 May 12 14:51:46.621149 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 249/473] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:51:46 2022] GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9 => generated 1739 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:51:46.625839 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-5ce8cc2f-f174-42ae-a9b0-db2de683951d tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/84ccb759-1bc2-4810-8e46-e34c0c29a0d5/ips" status: 200 len: 149 microversion: 2.1 time: 0.072085 May 12 14:51:46.626417 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 225/474] 10.222.0.49 () {58 vars in 1247 bytes} [Thu May 12 14:51:46 2022] GET /compute/v2.1/servers/84ccb759-1bc2-4810-8e46-e34c0c29a0d5/ips => generated 149 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 14:51:46.637962 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-aee1c925-5aba-4911-87ce-df4007e3fd24 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "94003eba-9177-41ee-9b62-f08509f8da8d"}} {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:51:46.653468 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-aee1c925-5aba-4911-87ce-df4007e3fd24 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 84ccb759-1bc2-4810-8e46-e34c0c29a0d5] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:51:46.653468 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-aee1c925-5aba-4911-87ce-df4007e3fd24 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:46.653468 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-aee1c925-5aba-4911-87ce-df4007e3fd24 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:46.653468 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-aee1c925-5aba-4911-87ce-df4007e3fd24 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:46.653817 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-aee1c925-5aba-4911-87ce-df4007e3fd24 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:46.813760 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.wsgi [None req-aee1c925-5aba-4911-87ce-df4007e3fd24 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] HTTP exception thrown: Invalid volume: volume 94003eba-9177-41ee-9b62-f08509f8da8d is already attached to instances: 64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7 May 12 14:51:46.813760 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-aee1c925-5aba-4911-87ce-df4007e3fd24 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Returning 400 to user: Invalid volume: volume 94003eba-9177-41ee-9b62-f08509f8da8d is already attached to instances: 64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7 {{(pid=102213) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 12 14:51:46.813760 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-aee1c925-5aba-4911-87ce-df4007e3fd24 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "POST /compute/v2.1/servers/84ccb759-1bc2-4810-8e46-e34c0c29a0d5/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.178661 May 12 14:51:46.813760 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 250/475] 10.222.0.49 () {60 vars in 1322 bytes} [Thu May 12 14:51:46 2022] POST /compute/v2.1/servers/84ccb759-1bc2-4810-8e46-e34c0c29a0d5/os-volume_attachments => generated 174 bytes in 180 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 12 14:51:46.821990 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-e35cfd2e-e111-4d2e-9b53-84823463eb05 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:51:46.822553 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-e35cfd2e-e111-4d2e-9b53-84823463eb05 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 84ccb759-1bc2-4810-8e46-e34c0c29a0d5] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:51:46.829833 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-e35cfd2e-e111-4d2e-9b53-84823463eb05 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:46.830280 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-e35cfd2e-e111-4d2e-9b53-84823463eb05 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:46.831065 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-e35cfd2e-e111-4d2e-9b53-84823463eb05 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:46.831499 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-e35cfd2e-e111-4d2e-9b53-84823463eb05 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:46.892989 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-e35cfd2e-e111-4d2e-9b53-84823463eb05 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 84ccb759-1bc2-4810-8e46-e34c0c29a0d5] Going to try to terminate instance {{(pid=102212) delete /opt/stack/nova/nova/compute/api.py:2562}} May 12 14:51:47.362946 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-e35cfd2e-e111-4d2e-9b53-84823463eb05 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "DELETE /compute/v2.1/servers/84ccb759-1bc2-4810-8e46-e34c0c29a0d5" status: 204 len: 0 microversion: 2.1 time: 0.544756 May 12 14:51:47.363505 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 226/476] 10.222.0.49 () {58 vars in 1238 bytes} [Thu May 12 14:51:46 2022] DELETE /compute/v2.1/servers/84ccb759-1bc2-4810-8e46-e34c0c29a0d5 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 14:51:47.372368 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-2fe04c0a-6f66-467f-b794-da136c4ec212 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:51:47.372984 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-2fe04c0a-6f66-467f-b794-da136c4ec212 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 84ccb759-1bc2-4810-8e46-e34c0c29a0d5] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:51:47.381161 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-2fe04c0a-6f66-467f-b794-da136c4ec212 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:47.382306 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-2fe04c0a-6f66-467f-b794-da136c4ec212 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:47.383110 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-2fe04c0a-6f66-467f-b794-da136c4ec212 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:47.383548 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-2fe04c0a-6f66-467f-b794-da136c4ec212 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:47.573266 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-2fe04c0a-6f66-467f-b794-da136c4ec212 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a641a08648b454780081ecc2e291066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a8451272cc41ebaf1598ed940bf09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:47.581371 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-2fe04c0a-6f66-467f-b794-da136c4ec212 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/84ccb759-1bc2-4810-8e46-e34c0c29a0d5" status: 200 len: 1680 microversion: 2.1 time: 0.213177 May 12 14:51:47.581920 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 251/477] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:51:47 2022] GET /compute/v2.1/servers/84ccb759-1bc2-4810-8e46-e34c0c29a0d5 => generated 1680 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:51:47.638879 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-28315008-9248-4345-8bbf-cb0bbffaa7cf tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:51:47.639525 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-28315008-9248-4345-8bbf-cb0bbffaa7cf tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:51:47.646679 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-28315008-9248-4345-8bbf-cb0bbffaa7cf tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:47.647175 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-28315008-9248-4345-8bbf-cb0bbffaa7cf tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:47.647939 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-28315008-9248-4345-8bbf-cb0bbffaa7cf tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:47.648379 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-28315008-9248-4345-8bbf-cb0bbffaa7cf tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:47.845913 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-28315008-9248-4345-8bbf-cb0bbffaa7cf tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:47.855123 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-28315008-9248-4345-8bbf-cb0bbffaa7cf tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:47.857033 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-28315008-9248-4345-8bbf-cb0bbffaa7cf tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:47.857804 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-28315008-9248-4345-8bbf-cb0bbffaa7cf tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9" status: 200 len: 1739 microversion: 2.20 time: 0.223089 May 12 14:51:47.858356 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 227/478] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:51:47 2022] GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9 => generated 1739 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:51:48.598025 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-a8a251af-ba38-4bef-be07-971b25c5179d tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:51:48.598658 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-a8a251af-ba38-4bef-be07-971b25c5179d tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 84ccb759-1bc2-4810-8e46-e34c0c29a0d5] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:51:48.605913 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-a8a251af-ba38-4bef-be07-971b25c5179d tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:48.606355 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-a8a251af-ba38-4bef-be07-971b25c5179d tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:48.607130 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-a8a251af-ba38-4bef-be07-971b25c5179d tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:48.607561 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-a8a251af-ba38-4bef-be07-971b25c5179d tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:48.817414 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-a8a251af-ba38-4bef-be07-971b25c5179d tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a641a08648b454780081ecc2e291066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a8451272cc41ebaf1598ed940bf09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:48.825563 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-a8a251af-ba38-4bef-be07-971b25c5179d tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/84ccb759-1bc2-4810-8e46-e34c0c29a0d5" status: 200 len: 1680 microversion: 2.1 time: 0.231263 May 12 14:51:48.826114 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 252/479] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:51:48 2022] GET /compute/v2.1/servers/84ccb759-1bc2-4810-8e46-e34c0c29a0d5 => generated 1680 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:51:48.876438 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-dd80434d-3656-4384-9c13-98a20d4d3122 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:51:48.876999 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-dd80434d-3656-4384-9c13-98a20d4d3122 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:51:48.884766 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-dd80434d-3656-4384-9c13-98a20d4d3122 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:48.885206 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-dd80434d-3656-4384-9c13-98a20d4d3122 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:48.885968 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-dd80434d-3656-4384-9c13-98a20d4d3122 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:48.886399 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-dd80434d-3656-4384-9c13-98a20d4d3122 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:49.085132 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-dd80434d-3656-4384-9c13-98a20d4d3122 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:49.093884 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-dd80434d-3656-4384-9c13-98a20d4d3122 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:49.095421 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-dd80434d-3656-4384-9c13-98a20d4d3122 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:49.096541 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-dd80434d-3656-4384-9c13-98a20d4d3122 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9" status: 200 len: 1739 microversion: 2.20 time: 0.223876 May 12 14:51:49.097089 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 228/480] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:51:48 2022] GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9 => generated 1739 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:51:49.842483 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-76374859-6567-487d-9e33-bd0900a6c694 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:51:49.843113 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-76374859-6567-487d-9e33-bd0900a6c694 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 84ccb759-1bc2-4810-8e46-e34c0c29a0d5] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:51:49.850301 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-76374859-6567-487d-9e33-bd0900a6c694 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:49.850739 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-76374859-6567-487d-9e33-bd0900a6c694 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:49.851522 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-76374859-6567-487d-9e33-bd0900a6c694 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:49.851947 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-76374859-6567-487d-9e33-bd0900a6c694 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:50.056486 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-76374859-6567-487d-9e33-bd0900a6c694 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a641a08648b454780081ecc2e291066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a8451272cc41ebaf1598ed940bf09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:50.065176 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-76374859-6567-487d-9e33-bd0900a6c694 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/84ccb759-1bc2-4810-8e46-e34c0c29a0d5" status: 200 len: 1680 microversion: 2.1 time: 0.226371 May 12 14:51:50.066060 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 253/481] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:51:49 2022] GET /compute/v2.1/servers/84ccb759-1bc2-4810-8e46-e34c0c29a0d5 => generated 1680 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:51:50.116601 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-c8b8a808-3f21-4bbb-a715-4892c62176e1 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:51:50.117193 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-c8b8a808-3f21-4bbb-a715-4892c62176e1 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:51:50.124706 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-c8b8a808-3f21-4bbb-a715-4892c62176e1 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:50.125159 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-c8b8a808-3f21-4bbb-a715-4892c62176e1 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:50.125938 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-c8b8a808-3f21-4bbb-a715-4892c62176e1 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:50.126372 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-c8b8a808-3f21-4bbb-a715-4892c62176e1 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:50.424460 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-c8b8a808-3f21-4bbb-a715-4892c62176e1 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:50.435000 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-c8b8a808-3f21-4bbb-a715-4892c62176e1 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:50.436527 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-c8b8a808-3f21-4bbb-a715-4892c62176e1 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:50.437876 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-c8b8a808-3f21-4bbb-a715-4892c62176e1 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9" status: 200 len: 1721 microversion: 2.20 time: 0.326382 May 12 14:51:50.451399 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 229/482] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:51:50 2022] GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9 => generated 1721 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:51:51.081338 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-2b07e5c7-5eef-4117-8c03-b677b0f2a486 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:51:51.082108 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-2b07e5c7-5eef-4117-8c03-b677b0f2a486 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 84ccb759-1bc2-4810-8e46-e34c0c29a0d5] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:51:51.090175 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-2b07e5c7-5eef-4117-8c03-b677b0f2a486 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:51.092056 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-2b07e5c7-5eef-4117-8c03-b677b0f2a486 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:51.092056 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-2b07e5c7-5eef-4117-8c03-b677b0f2a486 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:51.092056 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-2b07e5c7-5eef-4117-8c03-b677b0f2a486 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:51.292507 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-2b07e5c7-5eef-4117-8c03-b677b0f2a486 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a641a08648b454780081ecc2e291066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a8451272cc41ebaf1598ed940bf09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:51.300535 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-2b07e5c7-5eef-4117-8c03-b677b0f2a486 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/84ccb759-1bc2-4810-8e46-e34c0c29a0d5" status: 200 len: 1680 microversion: 2.1 time: 0.222927 May 12 14:51:51.301085 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 254/483] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:51:51 2022] GET /compute/v2.1/servers/84ccb759-1bc2-4810-8e46-e34c0c29a0d5 => generated 1680 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:51:51.460129 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-7cddf4a4-9a03-4515-852d-adfc2570124b tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:51:51.460759 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-7cddf4a4-9a03-4515-852d-adfc2570124b tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:51:51.468460 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-7cddf4a4-9a03-4515-852d-adfc2570124b tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:51.468904 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-7cddf4a4-9a03-4515-852d-adfc2570124b tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:51.469661 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-7cddf4a4-9a03-4515-852d-adfc2570124b tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:51.470090 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-7cddf4a4-9a03-4515-852d-adfc2570124b tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:51.694783 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-7cddf4a4-9a03-4515-852d-adfc2570124b tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:51.703854 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-7cddf4a4-9a03-4515-852d-adfc2570124b tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:51.706948 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-7cddf4a4-9a03-4515-852d-adfc2570124b tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:51.706948 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-7cddf4a4-9a03-4515-852d-adfc2570124b tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9" status: 200 len: 1721 microversion: 2.20 time: 0.251185 May 12 14:51:51.707411 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 230/484] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:51:51 2022] GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9 => generated 1721 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:51:52.317449 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-d3e00a90-1f29-4e64-9dfe-b6e5f43677e0 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:51:52.318061 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-d3e00a90-1f29-4e64-9dfe-b6e5f43677e0 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 84ccb759-1bc2-4810-8e46-e34c0c29a0d5] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:51:52.325992 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-d3e00a90-1f29-4e64-9dfe-b6e5f43677e0 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:52.326470 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-d3e00a90-1f29-4e64-9dfe-b6e5f43677e0 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:52.327286 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-d3e00a90-1f29-4e64-9dfe-b6e5f43677e0 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:52.327724 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-d3e00a90-1f29-4e64-9dfe-b6e5f43677e0 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:52.525887 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-d3e00a90-1f29-4e64-9dfe-b6e5f43677e0 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a641a08648b454780081ecc2e291066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a8451272cc41ebaf1598ed940bf09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:52.534525 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-d3e00a90-1f29-4e64-9dfe-b6e5f43677e0 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/84ccb759-1bc2-4810-8e46-e34c0c29a0d5" status: 200 len: 1680 microversion: 2.1 time: 0.220769 May 12 14:51:52.535152 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 255/485] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:51:52 2022] GET /compute/v2.1/servers/84ccb759-1bc2-4810-8e46-e34c0c29a0d5 => generated 1680 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:51:52.725412 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-1b8ced7a-b670-4bde-8978-0632f5476454 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:51:52.726237 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-1b8ced7a-b670-4bde-8978-0632f5476454 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:51:52.733844 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-1b8ced7a-b670-4bde-8978-0632f5476454 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:52.734227 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-1b8ced7a-b670-4bde-8978-0632f5476454 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:52.735041 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-1b8ced7a-b670-4bde-8978-0632f5476454 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:52.735483 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-1b8ced7a-b670-4bde-8978-0632f5476454 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:53.142481 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-1b8ced7a-b670-4bde-8978-0632f5476454 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:53.151277 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-1b8ced7a-b670-4bde-8978-0632f5476454 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:53.153287 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-1b8ced7a-b670-4bde-8978-0632f5476454 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:53.154797 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-1b8ced7a-b670-4bde-8978-0632f5476454 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9" status: 200 len: 1721 microversion: 2.20 time: 0.433207 May 12 14:51:53.166771 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 231/486] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:51:52 2022] GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9 => generated 1721 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:51:53.551403 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-b499e641-99bb-416d-b328-13b38710d1e5 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:51:53.552023 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-b499e641-99bb-416d-b328-13b38710d1e5 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 84ccb759-1bc2-4810-8e46-e34c0c29a0d5] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:51:53.559290 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-b499e641-99bb-416d-b328-13b38710d1e5 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:53.561946 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-b499e641-99bb-416d-b328-13b38710d1e5 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:53.561946 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-b499e641-99bb-416d-b328-13b38710d1e5 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:53.561946 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-b499e641-99bb-416d-b328-13b38710d1e5 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:53.680461 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-b499e641-99bb-416d-b328-13b38710d1e5 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a641a08648b454780081ecc2e291066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a8451272cc41ebaf1598ed940bf09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:53.688936 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-b499e641-99bb-416d-b328-13b38710d1e5 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/84ccb759-1bc2-4810-8e46-e34c0c29a0d5" status: 200 len: 1612 microversion: 2.1 time: 0.141802 May 12 14:51:53.689432 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 256/487] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:51:53 2022] GET /compute/v2.1/servers/84ccb759-1bc2-4810-8e46-e34c0c29a0d5 => generated 1612 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:51:54.176072 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-458d238d-3bd3-4dd2-b677-caf035f17529 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:51:54.177718 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-458d238d-3bd3-4dd2-b677-caf035f17529 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:51:54.213114 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-458d238d-3bd3-4dd2-b677-caf035f17529 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:54.213114 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-458d238d-3bd3-4dd2-b677-caf035f17529 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:54.213114 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-458d238d-3bd3-4dd2-b677-caf035f17529 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:54.213114 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-458d238d-3bd3-4dd2-b677-caf035f17529 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:54.276348 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [req-525a4462-d69e-4640-979d-8de412a6b58b req-e9b53ba4-95cd-497d-afc5-694cf9385017 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84ccb759-1bc2-4810-8e46-e34c0c29a0d5", "name": "network-vif-deleted", "tag": "941ee56d-a8a8-4017-bba8-1c38eaac468b"}]} {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:51:54.277943 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:51:54.277943 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: warnings.warn(msg) May 12 14:51:54.289821 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [req-525a4462-d69e-4640-979d-8de412a6b58b req-e9b53ba4-95cd-497d-afc5-694cf9385017 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:54.290660 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [req-525a4462-d69e-4640-979d-8de412a6b58b req-e9b53ba4-95cd-497d-afc5-694cf9385017 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:54.307838 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.compute.server_external_events [req-525a4462-d69e-4640-979d-8de412a6b58b req-e9b53ba4-95cd-497d-afc5-694cf9385017 service nova] Creating event network-vif-deleted:941ee56d-a8a8-4017-bba8-1c38eaac468b for instance 84ccb759-1bc2-4810-8e46-e34c0c29a0d5 on hv-cinder-83118 May 12 14:51:54.313779 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [req-525a4462-d69e-4640-979d-8de412a6b58b req-e9b53ba4-95cd-497d-afc5-694cf9385017 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041879 May 12 14:51:54.314731 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 257/488] 10.222.0.49 () {64 vars in 1317 bytes} [Thu May 12 14:51:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 14:51:54.437571 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-458d238d-3bd3-4dd2-b677-caf035f17529 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:54.447388 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-458d238d-3bd3-4dd2-b677-caf035f17529 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:54.449268 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-458d238d-3bd3-4dd2-b677-caf035f17529 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:54.450637 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-458d238d-3bd3-4dd2-b677-caf035f17529 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9" status: 200 len: 1721 microversion: 2.20 time: 0.280265 May 12 14:51:54.451539 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 232/489] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:51:54 2022] GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9 => generated 1721 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:51:54.710076 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-3bcb913d-92a3-40af-b70b-decbf59aa208 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:51:54.712571 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-3bcb913d-92a3-40af-b70b-decbf59aa208 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 84ccb759-1bc2-4810-8e46-e34c0c29a0d5] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:51:54.724270 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-3bcb913d-92a3-40af-b70b-decbf59aa208 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:54.725280 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-3bcb913d-92a3-40af-b70b-decbf59aa208 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:54.726749 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-3bcb913d-92a3-40af-b70b-decbf59aa208 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:54.727721 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-3bcb913d-92a3-40af-b70b-decbf59aa208 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:54.861807 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-3bcb913d-92a3-40af-b70b-decbf59aa208 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a641a08648b454780081ecc2e291066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a8451272cc41ebaf1598ed940bf09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:54.875098 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-3bcb913d-92a3-40af-b70b-decbf59aa208 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/84ccb759-1bc2-4810-8e46-e34c0c29a0d5" status: 200 len: 1612 microversion: 2.1 time: 0.170306 May 12 14:51:54.879172 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 258/490] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:51:54 2022] GET /compute/v2.1/servers/84ccb759-1bc2-4810-8e46-e34c0c29a0d5 => generated 1612 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:51:54.906996 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [req-e1fcb3d3-7d1a-43a2-b43c-a7675392156c req-d6cbb2c9-74f5-44d7-adb2-b086989eea54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9", "name": "network-vif-unplugged", "status": "completed", "tag": "892fd785-17e4-4442-9f7d-2e5d18b22e9f"}]} {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:51:54.906996 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:51:54.906996 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: warnings.warn(msg) May 12 14:51:54.911933 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [req-e1fcb3d3-7d1a-43a2-b43c-a7675392156c req-d6cbb2c9-74f5-44d7-adb2-b086989eea54 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:54.912638 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [req-e1fcb3d3-7d1a-43a2-b43c-a7675392156c req-d6cbb2c9-74f5-44d7-adb2-b086989eea54 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:54.934034 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.compute.server_external_events [req-e1fcb3d3-7d1a-43a2-b43c-a7675392156c req-d6cbb2c9-74f5-44d7-adb2-b086989eea54 service nova] Creating event network-vif-unplugged:892fd785-17e4-4442-9f7d-2e5d18b22e9f for instance a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9 on hv-cinder-83118 May 12 14:51:54.939899 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [req-e1fcb3d3-7d1a-43a2-b43c-a7675392156c req-d6cbb2c9-74f5-44d7-adb2-b086989eea54 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045959 May 12 14:51:54.940717 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 233/491] 10.222.0.49 () {64 vars in 1317 bytes} [Thu May 12 14:51:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:51:55.470097 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-26293c41-baa8-440b-a5b9-79dbcd97efdb tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:51:55.471066 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-26293c41-baa8-440b-a5b9-79dbcd97efdb tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:51:55.479596 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-26293c41-baa8-440b-a5b9-79dbcd97efdb tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:55.480107 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-26293c41-baa8-440b-a5b9-79dbcd97efdb tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:55.481030 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-26293c41-baa8-440b-a5b9-79dbcd97efdb tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:55.481456 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-26293c41-baa8-440b-a5b9-79dbcd97efdb tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:55.761275 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-26293c41-baa8-440b-a5b9-79dbcd97efdb tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:55.770520 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-26293c41-baa8-440b-a5b9-79dbcd97efdb tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:55.772141 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-26293c41-baa8-440b-a5b9-79dbcd97efdb tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:55.773284 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-26293c41-baa8-440b-a5b9-79dbcd97efdb tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9" status: 200 len: 1721 microversion: 2.20 time: 0.307565 May 12 14:51:55.774044 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 259/492] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:51:55 2022] GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9 => generated 1721 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:51:55.894086 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-54e8db79-1a72-4e74-a378-93a15edbc3e5 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:51:55.894786 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-54e8db79-1a72-4e74-a378-93a15edbc3e5 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 84ccb759-1bc2-4810-8e46-e34c0c29a0d5] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:51:55.903191 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-54e8db79-1a72-4e74-a378-93a15edbc3e5 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:55.903680 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-54e8db79-1a72-4e74-a378-93a15edbc3e5 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:55.904468 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-54e8db79-1a72-4e74-a378-93a15edbc3e5 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:55.905135 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-54e8db79-1a72-4e74-a378-93a15edbc3e5 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:56.002243 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-54e8db79-1a72-4e74-a378-93a15edbc3e5 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:56.002949 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-54e8db79-1a72-4e74-a378-93a15edbc3e5 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:56.004263 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.objects.instance [None req-54e8db79-1a72-4e74-a378-93a15edbc3e5 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lazy-loading 'fault' on Instance uuid 84ccb759-1bc2-4810-8e46-e34c0c29a0d5 {{(pid=102212) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 12 14:51:56.247588 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-54e8db79-1a72-4e74-a378-93a15edbc3e5 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a641a08648b454780081ecc2e291066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a8451272cc41ebaf1598ed940bf09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:56.257544 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-54e8db79-1a72-4e74-a378-93a15edbc3e5 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/84ccb759-1bc2-4810-8e46-e34c0c29a0d5" status: 200 len: 1330 microversion: 2.1 time: 0.367508 May 12 14:51:56.258437 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 234/493] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:51:55 2022] GET /compute/v2.1/servers/84ccb759-1bc2-4810-8e46-e34c0c29a0d5 => generated 1330 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:51:56.792782 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-e9c59294-7f22-466b-bce2-3912477bccdb tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:51:56.793426 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-e9c59294-7f22-466b-bce2-3912477bccdb tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:51:56.800734 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e9c59294-7f22-466b-bce2-3912477bccdb tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:56.801179 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e9c59294-7f22-466b-bce2-3912477bccdb tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:56.801969 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e9c59294-7f22-466b-bce2-3912477bccdb tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:56.802391 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e9c59294-7f22-466b-bce2-3912477bccdb tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:57.015134 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-e9c59294-7f22-466b-bce2-3912477bccdb tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:57.023781 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-e9c59294-7f22-466b-bce2-3912477bccdb tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:57.025287 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-e9c59294-7f22-466b-bce2-3912477bccdb tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:57.026422 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-e9c59294-7f22-466b-bce2-3912477bccdb tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9" status: 200 len: 1664 microversion: 2.20 time: 0.237751 May 12 14:51:57.027010 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 260/494] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:51:56 2022] GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9 => generated 1664 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:51:57.045097 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-6d7afe94-6396-4373-9c4b-796aabe3b2c5 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "548229b6-b184-497b-9792-cc3455d79ad7"}} {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:51:57.046150 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-6d7afe94-6396-4373-9c4b-796aabe3b2c5 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:51:57.054339 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-6d7afe94-6396-4373-9c4b-796aabe3b2c5 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:57.054787 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-6d7afe94-6396-4373-9c4b-796aabe3b2c5 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:57.055677 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-6d7afe94-6396-4373-9c4b-796aabe3b2c5 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:57.056181 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-6d7afe94-6396-4373-9c4b-796aabe3b2c5 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:57.275175 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-26f89519-803a-4f5f-8fb3-e6dae7d46207 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:51:57.275788 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-26f89519-803a-4f5f-8fb3-e6dae7d46207 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 84ccb759-1bc2-4810-8e46-e34c0c29a0d5] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:51:57.283313 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-26f89519-803a-4f5f-8fb3-e6dae7d46207 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:57.283766 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-26f89519-803a-4f5f-8fb3-e6dae7d46207 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:57.284535 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-26f89519-803a-4f5f-8fb3-e6dae7d46207 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:57.284973 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-26f89519-803a-4f5f-8fb3-e6dae7d46207 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:57.336289 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.wsgi [None req-26f89519-803a-4f5f-8fb3-e6dae7d46207 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] HTTP exception thrown: Instance 84ccb759-1bc2-4810-8e46-e34c0c29a0d5 could not be found. May 12 14:51:57.336893 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-26f89519-803a-4f5f-8fb3-e6dae7d46207 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Returning 404 to user: Instance 84ccb759-1bc2-4810-8e46-e34c0c29a0d5 could not be found. {{(pid=102213) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 12 14:51:57.341639 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-26f89519-803a-4f5f-8fb3-e6dae7d46207 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/84ccb759-1bc2-4810-8e46-e34c0c29a0d5" status: 404 len: 111 microversion: 2.1 time: 0.066933 May 12 14:51:57.341639 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 261/495] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:51:57 2022] GET /compute/v2.1/servers/84ccb759-1bc2-4810-8e46-e34c0c29a0d5 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 12 14:51:57.348249 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-f349b5fb-f9b1-4eb4-a7e0-93f71aee18ca tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '.version_select at 0x7ff77fbdf790>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:51:57.498942 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-f349b5fb-f9b1-4eb4-a7e0-93f71aee18ca tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-90070329" status: 202 len: 0 microversion: 2.1 time: 0.154115 May 12 14:51:57.499591 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 262/496] 10.222.0.49 () {58 vars in 1214 bytes} [Thu May 12 14:51:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-90070329 => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 12 14:51:58.619520 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-6d7afe94-6396-4373-9c4b-796aabe3b2c5 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "POST /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.578345 May 12 14:51:58.620713 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 235/497] 10.222.0.49 () {62 vars in 1363 bytes} [Thu May 12 14:51:57 2022] POST /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9/os-volume_attachments => generated 188 bytes in 1580 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 14:51:58.801937 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-840ee2f2-620e-4d97-91db-9fc138fdf619 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:51:58.802511 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-840ee2f2-620e-4d97-91db-9fc138fdf619 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:51:58.811472 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-840ee2f2-620e-4d97-91db-9fc138fdf619 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:58.811705 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-840ee2f2-620e-4d97-91db-9fc138fdf619 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:58.812385 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-840ee2f2-620e-4d97-91db-9fc138fdf619 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:58.812825 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-840ee2f2-620e-4d97-91db-9fc138fdf619 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:59.019518 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-7892b129-769b-413a-bda5-4e97d6f99e53 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:51:59.020094 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-7892b129-769b-413a-bda5-4e97d6f99e53 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:51:59.027789 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-7892b129-769b-413a-bda5-4e97d6f99e53 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:59.028300 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-7892b129-769b-413a-bda5-4e97d6f99e53 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:59.030649 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-7892b129-769b-413a-bda5-4e97d6f99e53 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:59.030649 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-7892b129-769b-413a-bda5-4e97d6f99e53 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:59.142642 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-840ee2f2-620e-4d97-91db-9fc138fdf619 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "POST /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9/action" status: 202 len: 0 microversion: 2.20 time: 0.344455 May 12 14:51:59.143500 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 263/498] 10.222.0.49 () {62 vars in 1318 bytes} [Thu May 12 14:51:58 2022] POST /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9/action => generated 0 bytes in 346 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 12 14:51:59.151717 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-622ca990-82ae-4f40-ae1f-10b56d418a92 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:51:59.152501 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-622ca990-82ae-4f40-ae1f-10b56d418a92 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:51:59.160671 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-622ca990-82ae-4f40-ae1f-10b56d418a92 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:59.161292 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-622ca990-82ae-4f40-ae1f-10b56d418a92 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:59.162222 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-622ca990-82ae-4f40-ae1f-10b56d418a92 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:59.163348 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-622ca990-82ae-4f40-ae1f-10b56d418a92 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:59.185666 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.objects.instance [None req-7892b129-769b-413a-bda5-4e97d6f99e53 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lazy-loading 'services' on Instance uuid 64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7 {{(pid=102212) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 12 14:51:59.383453 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-622ca990-82ae-4f40-ae1f-10b56d418a92 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:59.393413 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-622ca990-82ae-4f40-ae1f-10b56d418a92 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:59.395008 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-622ca990-82ae-4f40-ae1f-10b56d418a92 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:51:59.396153 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-622ca990-82ae-4f40-ae1f-10b56d418a92 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9" status: 200 len: 1750 microversion: 2.20 time: 0.248315 May 12 14:51:59.397215 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 264/499] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:51:59 2022] GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9 => generated 1750 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:51:59.670429 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-7892b129-769b-413a-bda5-4e97d6f99e53 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "DELETE /compute/v2.1/servers/64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7/os-volume_attachments/94003eba-9177-41ee-9b62-f08509f8da8d" status: 202 len: 0 microversion: 2.1 time: 0.654662 May 12 14:51:59.679594 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-f3c8bab9-3c10-42a6-9338-f509509bc650 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:51:59.680654 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-f3c8bab9-3c10-42a6-9338-f509509bc650 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:51:59.683237 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 236/500] 10.222.0.49 () {58 vars in 1415 bytes} [Thu May 12 14:51:59 2022] DELETE /compute/v2.1/servers/64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7/os-volume_attachments/94003eba-9177-41ee-9b62-f08509f8da8d => generated 0 bytes in 660 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 14:51:59.690399 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-f3c8bab9-3c10-42a6-9338-f509509bc650 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:59.690974 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-f3c8bab9-3c10-42a6-9338-f509509bc650 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:59.692020 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-f3c8bab9-3c10-42a6-9338-f509509bc650 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:59.692736 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-f3c8bab9-3c10-42a6-9338-f509509bc650 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:59.766763 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-f3c8bab9-3c10-42a6-9338-f509509bc650 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091046 May 12 14:51:59.767560 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 265/501] 10.222.0.49 () {58 vars in 1301 bytes} [Thu May 12 14:51:59 2022] GET /compute/v2.1/servers/64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:51:59.901190 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-613d9abb-966f-4867-b247-e4c84b752587 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:51:59.901770 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-613d9abb-966f-4867-b247-e4c84b752587 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] [instance: 6809f21a-9df9-499a-aec9-c628d50b64e3] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:51:59.909699 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-613d9abb-966f-4867-b247-e4c84b752587 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:59.910149 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-613d9abb-966f-4867-b247-e4c84b752587 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:51:59.910953 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-613d9abb-966f-4867-b247-e4c84b752587 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:51:59.911387 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-613d9abb-966f-4867-b247-e4c84b752587 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:00.099691 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.objects.instance [None req-613d9abb-966f-4867-b247-e4c84b752587 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lazy-loading 'services' on Instance uuid 6809f21a-9df9-499a-aec9-c628d50b64e3 {{(pid=102212) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 12 14:52:00.417363 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-e477c21b-01b4-4596-8fc3-b7068f79e975 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:00.418955 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-e477c21b-01b4-4596-8fc3-b7068f79e975 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:52:00.427300 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e477c21b-01b4-4596-8fc3-b7068f79e975 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:00.428081 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e477c21b-01b4-4596-8fc3-b7068f79e975 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:00.430357 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e477c21b-01b4-4596-8fc3-b7068f79e975 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:00.430357 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e477c21b-01b4-4596-8fc3-b7068f79e975 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:00.432827 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-613d9abb-966f-4867-b247-e4c84b752587 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] 10.222.0.49 "DELETE /compute/v2.1/servers/6809f21a-9df9-499a-aec9-c628d50b64e3/os-volume_attachments/df5d3548-c95e-4ce3-af4f-a0060a2fbf7e" status: 202 len: 0 microversion: 2.1 time: 0.536226 May 12 14:52:00.433426 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 237/502] 10.222.0.49 () {58 vars in 1415 bytes} [Thu May 12 14:51:59 2022] DELETE /compute/v2.1/servers/6809f21a-9df9-499a-aec9-c628d50b64e3/os-volume_attachments/df5d3548-c95e-4ce3-af4f-a0060a2fbf7e => generated 0 bytes in 538 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 14:52:00.668818 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-e477c21b-01b4-4596-8fc3-b7068f79e975 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:00.676447 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-e477c21b-01b4-4596-8fc3-b7068f79e975 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:00.679706 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-e477c21b-01b4-4596-8fc3-b7068f79e975 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:00.681359 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-e477c21b-01b4-4596-8fc3-b7068f79e975 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9" status: 200 len: 1750 microversion: 2.20 time: 0.269607 May 12 14:52:00.682465 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 266/503] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:52:00 2022] GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9 => generated 1750 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:52:00.778546 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-d8950c64-fb6f-40ce-83e6-96963703a1cd tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:00.779739 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-d8950c64-fb6f-40ce-83e6-96963703a1cd tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:52:00.788164 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-d8950c64-fb6f-40ce-83e6-96963703a1cd tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:00.788598 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-d8950c64-fb6f-40ce-83e6-96963703a1cd tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:00.795424 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-d8950c64-fb6f-40ce-83e6-96963703a1cd tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:00.795424 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-d8950c64-fb6f-40ce-83e6-96963703a1cd tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:00.862079 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-d8950c64-fb6f-40ce-83e6-96963703a1cd tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087961 May 12 14:52:00.862799 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 238/504] 10.222.0.49 () {58 vars in 1301 bytes} [Thu May 12 14:52:00 2022] GET /compute/v2.1/servers/64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:52:01.363291 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-e6b68127-9127-43b9-9809-72b36b5dd459 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:01.363687 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-e6b68127-9127-43b9-9809-72b36b5dd459 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 3062e66d-4c2a-4212-b186-ecafec6bde2e] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:52:01.370945 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e6b68127-9127-43b9-9809-72b36b5dd459 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:01.371399 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e6b68127-9127-43b9-9809-72b36b5dd459 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:01.372206 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e6b68127-9127-43b9-9809-72b36b5dd459 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:01.372796 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e6b68127-9127-43b9-9809-72b36b5dd459 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:01.587400 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.objects.instance [None req-e6b68127-9127-43b9-9809-72b36b5dd459 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lazy-loading 'services' on Instance uuid 3062e66d-4c2a-4212-b186-ecafec6bde2e {{(pid=102213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 12 14:52:01.700630 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-a9a423bb-0c68-4dc2-bc25-4247444ce78e tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:01.701272 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-a9a423bb-0c68-4dc2-bc25-4247444ce78e tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:52:01.708666 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-a9a423bb-0c68-4dc2-bc25-4247444ce78e tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:01.709144 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-a9a423bb-0c68-4dc2-bc25-4247444ce78e tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:01.709928 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-a9a423bb-0c68-4dc2-bc25-4247444ce78e tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:01.710367 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-a9a423bb-0c68-4dc2-bc25-4247444ce78e tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:01.922205 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-a9a423bb-0c68-4dc2-bc25-4247444ce78e tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:01.931983 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-a9a423bb-0c68-4dc2-bc25-4247444ce78e tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:01.933478 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-a9a423bb-0c68-4dc2-bc25-4247444ce78e tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:01.934604 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-a9a423bb-0c68-4dc2-bc25-4247444ce78e tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9" status: 200 len: 1752 microversion: 2.20 time: 0.237840 May 12 14:52:01.935199 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 239/505] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:52:01 2022] GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9 => generated 1752 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 14:52:01.939718 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-a8c2062c-b659-4b0e-82f2-3355f5171970 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:01.940660 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-a8c2062c-b659-4b0e-82f2-3355f5171970 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:52:01.947690 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-a8c2062c-b659-4b0e-82f2-3355f5171970 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:01.948142 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-a8c2062c-b659-4b0e-82f2-3355f5171970 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:01.948965 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-a8c2062c-b659-4b0e-82f2-3355f5171970 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:01.949252 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-e6b68127-9127-43b9-9809-72b36b5dd459 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "DELETE /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e/os-volume_attachments/c56f716e-f085-4f7a-8744-036b04bffcdf" status: 202 len: 0 microversion: 2.1 time: 0.589751 May 12 14:52:01.949404 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-a8c2062c-b659-4b0e-82f2-3355f5171970 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:01.949836 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 267/506] 10.222.0.49 () {58 vars in 1415 bytes} [Thu May 12 14:52:01 2022] DELETE /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e/os-volume_attachments/c56f716e-f085-4f7a-8744-036b04bffcdf => generated 0 bytes in 591 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 14:52:02.018091 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-a8c2062c-b659-4b0e-82f2-3355f5171970 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.078239 May 12 14:52:02.018091 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 240/507] 10.222.0.49 () {58 vars in 1301 bytes} [Thu May 12 14:52:01 2022] GET /compute/v2.1/servers/64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7/os-volume_attachments => generated 25 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 12 14:52:02.107969 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-8467a7f9-32b6-4891-9eb3-dd4bd597087c tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:02.108560 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-8467a7f9-32b6-4891-9eb3-dd4bd597087c tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:52:02.117034 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-8467a7f9-32b6-4891-9eb3-dd4bd597087c tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:02.117484 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-8467a7f9-32b6-4891-9eb3-dd4bd597087c tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:02.120923 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-8467a7f9-32b6-4891-9eb3-dd4bd597087c tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:02.120923 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-8467a7f9-32b6-4891-9eb3-dd4bd597087c tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:02.180803 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-8467a7f9-32b6-4891-9eb3-dd4bd597087c tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7] Going to try to terminate instance {{(pid=102213) delete /opt/stack/nova/nova/compute/api.py:2562}} May 12 14:52:02.739512 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-8467a7f9-32b6-4891-9eb3-dd4bd597087c tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "DELETE /compute/v2.1/servers/64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7" status: 204 len: 0 microversion: 2.1 time: 0.635169 May 12 14:52:02.740158 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 268/508] 10.222.0.49 () {58 vars in 1238 bytes} [Thu May 12 14:52:02 2022] DELETE /compute/v2.1/servers/64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7 => generated 0 bytes in 637 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 14:52:02.754538 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-d19b486a-34dc-4050-ad5b-65840b9384e4 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:02.754538 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-d19b486a-34dc-4050-ad5b-65840b9384e4 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:52:02.757978 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-d19b486a-34dc-4050-ad5b-65840b9384e4 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:02.758365 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-d19b486a-34dc-4050-ad5b-65840b9384e4 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:02.759163 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-d19b486a-34dc-4050-ad5b-65840b9384e4 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:02.759594 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-d19b486a-34dc-4050-ad5b-65840b9384e4 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:02.954616 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-00d2eafd-4466-4ff4-9af2-eec8a2d7bf59 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:02.955364 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-00d2eafd-4466-4ff4-9af2-eec8a2d7bf59 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:52:02.963263 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-00d2eafd-4466-4ff4-9af2-eec8a2d7bf59 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:02.963708 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-00d2eafd-4466-4ff4-9af2-eec8a2d7bf59 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:02.964481 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-00d2eafd-4466-4ff4-9af2-eec8a2d7bf59 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:02.965024 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-00d2eafd-4466-4ff4-9af2-eec8a2d7bf59 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:03.241262 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-00d2eafd-4466-4ff4-9af2-eec8a2d7bf59 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:03.251292 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-00d2eafd-4466-4ff4-9af2-eec8a2d7bf59 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:03.252796 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-00d2eafd-4466-4ff4-9af2-eec8a2d7bf59 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:03.253922 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-00d2eafd-4466-4ff4-9af2-eec8a2d7bf59 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9" status: 200 len: 1752 microversion: 2.20 time: 0.304003 May 12 14:52:03.254486 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 269/509] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:52:02 2022] GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9 => generated 1752 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 14:52:03.271970 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-d19b486a-34dc-4050-ad5b-65840b9384e4 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a641a08648b454780081ecc2e291066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a8451272cc41ebaf1598ed940bf09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:03.276586 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-d19b486a-34dc-4050-ad5b-65840b9384e4 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7" status: 200 len: 1680 microversion: 2.1 time: 0.531084 May 12 14:52:03.277104 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 241/510] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:52:02 2022] GET /compute/v2.1/servers/64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7 => generated 1680 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:52:03.845766 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-b1445430-7b04-4bd7-a588-ebc501dc2195 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:03.846263 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-b1445430-7b04-4bd7-a588-ebc501dc2195 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] [instance: 6809f21a-9df9-499a-aec9-c628d50b64e3] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:52:03.853852 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-b1445430-7b04-4bd7-a588-ebc501dc2195 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:03.854291 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-b1445430-7b04-4bd7-a588-ebc501dc2195 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:03.864120 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-b1445430-7b04-4bd7-a588-ebc501dc2195 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:03.864120 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-b1445430-7b04-4bd7-a588-ebc501dc2195 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:03.915183 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-b1445430-7b04-4bd7-a588-ebc501dc2195 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] [instance: 6809f21a-9df9-499a-aec9-c628d50b64e3] Going to try to terminate instance {{(pid=102213) delete /opt/stack/nova/nova/compute/api.py:2562}} May 12 14:52:04.272817 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-1dc8da0a-89c4-46ae-b159-be45ca1b3824 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:04.273446 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-1dc8da0a-89c4-46ae-b159-be45ca1b3824 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:52:04.281350 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-1dc8da0a-89c4-46ae-b159-be45ca1b3824 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:04.281800 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-1dc8da0a-89c4-46ae-b159-be45ca1b3824 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:04.282843 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-1dc8da0a-89c4-46ae-b159-be45ca1b3824 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:04.283283 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-1dc8da0a-89c4-46ae-b159-be45ca1b3824 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:04.414014 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-b1445430-7b04-4bd7-a588-ebc501dc2195 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] 10.222.0.49 "DELETE /compute/v2.1/servers/6809f21a-9df9-499a-aec9-c628d50b64e3" status: 204 len: 0 microversion: 2.1 time: 0.571484 May 12 14:52:04.414669 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 270/511] 10.222.0.49 () {58 vars in 1238 bytes} [Thu May 12 14:52:03 2022] DELETE /compute/v2.1/servers/6809f21a-9df9-499a-aec9-c628d50b64e3 => generated 0 bytes in 573 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 14:52:04.420287 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-42adfaf5-59b8-4c9d-aab1-22ea68823b50 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:04.420986 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-42adfaf5-59b8-4c9d-aab1-22ea68823b50 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:52:04.428599 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-42adfaf5-59b8-4c9d-aab1-22ea68823b50 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:04.429096 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-42adfaf5-59b8-4c9d-aab1-22ea68823b50 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:04.429875 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-42adfaf5-59b8-4c9d-aab1-22ea68823b50 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:04.430301 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-42adfaf5-59b8-4c9d-aab1-22ea68823b50 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:04.640354 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-42adfaf5-59b8-4c9d-aab1-22ea68823b50 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a641a08648b454780081ecc2e291066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a8451272cc41ebaf1598ed940bf09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:04.657162 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-42adfaf5-59b8-4c9d-aab1-22ea68823b50 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7" status: 200 len: 1680 microversion: 2.1 time: 0.234192 May 12 14:52:04.657162 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 271/512] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:52:04 2022] GET /compute/v2.1/servers/64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7 => generated 1680 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:52:04.668652 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-1dc8da0a-89c4-46ae-b159-be45ca1b3824 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:04.672511 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-5bc8aeb4-312c-43e2-8aa1-307142bb4c46 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:04.673146 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-5bc8aeb4-312c-43e2-8aa1-307142bb4c46 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] [instance: 6809f21a-9df9-499a-aec9-c628d50b64e3] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:52:04.681307 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-5bc8aeb4-312c-43e2-8aa1-307142bb4c46 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:04.681748 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-5bc8aeb4-312c-43e2-8aa1-307142bb4c46 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:04.682155 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-1dc8da0a-89c4-46ae-b159-be45ca1b3824 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:04.682872 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-5bc8aeb4-312c-43e2-8aa1-307142bb4c46 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:04.683308 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-5bc8aeb4-312c-43e2-8aa1-307142bb4c46 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:04.684239 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-1dc8da0a-89c4-46ae-b159-be45ca1b3824 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:04.685637 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-1dc8da0a-89c4-46ae-b159-be45ca1b3824 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9" status: 200 len: 1752 microversion: 2.20 time: 0.417149 May 12 14:52:04.686679 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 242/513] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:52:04 2022] GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9 => generated 1752 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 14:52:04.889017 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-5bc8aeb4-312c-43e2-8aa1-307142bb4c46 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab371128e42444f49bc63661feaf7cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ed089c81294b4981046ede5ed951bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:04.897070 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-5bc8aeb4-312c-43e2-8aa1-307142bb4c46 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] 10.222.0.49 "GET /compute/v2.1/servers/6809f21a-9df9-499a-aec9-c628d50b64e3" status: 200 len: 1514 microversion: 2.1 time: 0.230119 May 12 14:52:04.898276 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 272/514] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:52:04 2022] GET /compute/v2.1/servers/6809f21a-9df9-499a-aec9-c628d50b64e3 => generated 1514 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:52:05.673491 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-39430835-045c-4673-b60c-3608b64799db tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:05.674117 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-39430835-045c-4673-b60c-3608b64799db tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:52:05.682027 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-39430835-045c-4673-b60c-3608b64799db tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:05.682484 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-39430835-045c-4673-b60c-3608b64799db tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:05.683291 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-39430835-045c-4673-b60c-3608b64799db tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:05.683734 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-39430835-045c-4673-b60c-3608b64799db tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:05.704406 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-e644ff00-3bbc-47bb-98b2-9917e0aa7fa2 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:05.705178 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-e644ff00-3bbc-47bb-98b2-9917e0aa7fa2 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:52:05.712924 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e644ff00-3bbc-47bb-98b2-9917e0aa7fa2 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:05.714268 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e644ff00-3bbc-47bb-98b2-9917e0aa7fa2 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:05.715191 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e644ff00-3bbc-47bb-98b2-9917e0aa7fa2 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:05.716079 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e644ff00-3bbc-47bb-98b2-9917e0aa7fa2 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:05.938627 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-e644ff00-3bbc-47bb-98b2-9917e0aa7fa2 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:05.947723 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-e644ff00-3bbc-47bb-98b2-9917e0aa7fa2 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:05.949335 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-e644ff00-3bbc-47bb-98b2-9917e0aa7fa2 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:05.950462 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-e644ff00-3bbc-47bb-98b2-9917e0aa7fa2 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9" status: 200 len: 1808 microversion: 2.20 time: 0.249900 May 12 14:52:05.958389 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 273/515] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:52:05 2022] GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9 => generated 1808 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 14:52:05.958389 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-da76874c-5944-4306-a899-f9610d9a658b tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:05.958389 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-da76874c-5944-4306-a899-f9610d9a658b tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] [instance: 6809f21a-9df9-499a-aec9-c628d50b64e3] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:52:05.963495 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-da76874c-5944-4306-a899-f9610d9a658b tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:05.963947 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-da76874c-5944-4306-a899-f9610d9a658b tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:05.964717 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-da76874c-5944-4306-a899-f9610d9a658b tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:05.965148 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-da76874c-5944-4306-a899-f9610d9a658b tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:06.156644 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-39430835-045c-4673-b60c-3608b64799db tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a641a08648b454780081ecc2e291066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a8451272cc41ebaf1598ed940bf09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:06.166041 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-39430835-045c-4673-b60c-3608b64799db tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7" status: 200 len: 1680 microversion: 2.1 time: 0.496321 May 12 14:52:06.177278 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 243/516] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:52:05 2022] GET /compute/v2.1/servers/64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7 => generated 1680 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:52:06.413192 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-7de31c1b-b17d-4ed3-a0fd-0fc03c715165 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:52:06.421435 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-7de31c1b-b17d-4ed3-a0fd-0fc03c715165 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:06.421892 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-7de31c1b-b17d-4ed3-a0fd-0fc03c715165 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:06.458017 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-da76874c-5944-4306-a899-f9610d9a658b tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab371128e42444f49bc63661feaf7cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ed089c81294b4981046ede5ed951bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:06.479742 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-da76874c-5944-4306-a899-f9610d9a658b tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] 10.222.0.49 "GET /compute/v2.1/servers/6809f21a-9df9-499a-aec9-c628d50b64e3" status: 200 len: 1514 microversion: 2.1 time: 0.527575 May 12 14:52:06.481171 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 274/517] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:52:05 2022] GET /compute/v2.1/servers/6809f21a-9df9-499a-aec9-c628d50b64e3 => generated 1514 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:52:06.482700 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-7de31c1b-b17d-4ed3-a0fd-0fc03c715165 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 3062e66d-4c2a-4212-b186-ecafec6bde2e] Going to try to stop instance {{(pid=102212) force_stop /opt/stack/nova/nova/compute/api.py:2602}} May 12 14:52:06.788504 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-7de31c1b-b17d-4ed3-a0fd-0fc03c715165 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "POST /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e/action" status: 202 len: 0 microversion: 2.1 time: 0.380237 May 12 14:52:06.789366 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 244/518] 10.222.0.49 () {60 vars in 1277 bytes} [Thu May 12 14:52:06 2022] POST /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e/action => generated 0 bytes in 382 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 12 14:52:06.798438 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-244e3bf2-358f-44ef-9032-fc2d770e870f tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:06.799290 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-244e3bf2-358f-44ef-9032-fc2d770e870f tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 3062e66d-4c2a-4212-b186-ecafec6bde2e] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:52:06.809599 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-244e3bf2-358f-44ef-9032-fc2d770e870f tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:06.810046 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-244e3bf2-358f-44ef-9032-fc2d770e870f tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:06.810904 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-244e3bf2-358f-44ef-9032-fc2d770e870f tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:06.811600 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-244e3bf2-358f-44ef-9032-fc2d770e870f tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:06.915958 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [req-a5ac6495-b31a-4530-92d3-cbc56c68a013 req-7f31dbfa-683f-4706-96c5-c40900d8ea70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7", "name": "network-vif-deleted", "tag": "b9ae57f3-8cbe-4bb3-80d3-db854a810952"}]} {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:52:06.917469 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:52:06.917469 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: warnings.warn(msg) May 12 14:52:06.935085 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [req-a5ac6495-b31a-4530-92d3-cbc56c68a013 req-7f31dbfa-683f-4706-96c5-c40900d8ea70 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:06.938582 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [req-a5ac6495-b31a-4530-92d3-cbc56c68a013 req-7f31dbfa-683f-4706-96c5-c40900d8ea70 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:06.966666 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.compute.server_external_events [req-a5ac6495-b31a-4530-92d3-cbc56c68a013 req-7f31dbfa-683f-4706-96c5-c40900d8ea70 service nova] Creating event network-vif-deleted:b9ae57f3-8cbe-4bb3-80d3-db854a810952 for instance 64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7 on hv-cinder-83118 May 12 14:52:06.971390 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [req-a5ac6495-b31a-4530-92d3-cbc56c68a013 req-7f31dbfa-683f-4706-96c5-c40900d8ea70 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060414 May 12 14:52:06.972083 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 245/519] 10.222.0.49 () {64 vars in 1317 bytes} [Thu May 12 14:52:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 14:52:06.977938 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-dcbbe4d6-e21d-4bef-b5e7-6ffe7bcd9dd1 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:06.979183 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-dcbbe4d6-e21d-4bef-b5e7-6ffe7bcd9dd1 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:52:06.987524 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-dcbbe4d6-e21d-4bef-b5e7-6ffe7bcd9dd1 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:06.988165 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-dcbbe4d6-e21d-4bef-b5e7-6ffe7bcd9dd1 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:06.988962 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-dcbbe4d6-e21d-4bef-b5e7-6ffe7bcd9dd1 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:06.989571 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-dcbbe4d6-e21d-4bef-b5e7-6ffe7bcd9dd1 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:07.270643 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-244e3bf2-358f-44ef-9032-fc2d770e870f tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e128ca83d6448c9ab1fe7dcc5467d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a090a68e336b4562aca524a95f550e04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:07.281785 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-244e3bf2-358f-44ef-9032-fc2d770e870f tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e" status: 200 len: 1679 microversion: 2.1 time: 0.488106 May 12 14:52:07.282610 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 275/520] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:52:06 2022] GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e => generated 1679 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:52:07.288925 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-dfbdfdb7-70db-40a1-8ddd-5640319e0eb0 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:07.293417 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-dcbbe4d6-e21d-4bef-b5e7-6ffe7bcd9dd1 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:07.293579 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-dfbdfdb7-70db-40a1-8ddd-5640319e0eb0 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:52:07.300709 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-dfbdfdb7-70db-40a1-8ddd-5640319e0eb0 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:07.301364 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-dfbdfdb7-70db-40a1-8ddd-5640319e0eb0 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:07.302303 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-dfbdfdb7-70db-40a1-8ddd-5640319e0eb0 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:07.302961 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-dfbdfdb7-70db-40a1-8ddd-5640319e0eb0 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:07.306089 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-dcbbe4d6-e21d-4bef-b5e7-6ffe7bcd9dd1 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:07.308738 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-dcbbe4d6-e21d-4bef-b5e7-6ffe7bcd9dd1 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:07.310215 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-dcbbe4d6-e21d-4bef-b5e7-6ffe7bcd9dd1 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9" status: 200 len: 1808 microversion: 2.20 time: 0.336672 May 12 14:52:07.310776 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 246/521] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:52:06 2022] GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9 => generated 1808 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:52:07.392323 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-dfbdfdb7-70db-40a1-8ddd-5640319e0eb0 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:07.392876 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-dfbdfdb7-70db-40a1-8ddd-5640319e0eb0 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:07.393412 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.objects.instance [None req-dfbdfdb7-70db-40a1-8ddd-5640319e0eb0 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lazy-loading 'fault' on Instance uuid 64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7 {{(pid=102213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 12 14:52:07.453016 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-dfbdfdb7-70db-40a1-8ddd-5640319e0eb0 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a641a08648b454780081ecc2e291066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a8451272cc41ebaf1598ed940bf09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:07.461929 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-dfbdfdb7-70db-40a1-8ddd-5640319e0eb0 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7" status: 200 len: 1329 microversion: 2.1 time: 0.177103 May 12 14:52:07.463086 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 276/522] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:52:07 2022] GET /compute/v2.1/servers/64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7 => generated 1329 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:52:07.499659 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-e7250ad8-e9b4-4da5-bf55-0f579ebba3f9 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:07.499659 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-e7250ad8-e9b4-4da5-bf55-0f579ebba3f9 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] [instance: 6809f21a-9df9-499a-aec9-c628d50b64e3] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:52:07.506913 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-e7250ad8-e9b4-4da5-bf55-0f579ebba3f9 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:07.507433 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-e7250ad8-e9b4-4da5-bf55-0f579ebba3f9 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:07.508687 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-e7250ad8-e9b4-4da5-bf55-0f579ebba3f9 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:07.509822 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-e7250ad8-e9b4-4da5-bf55-0f579ebba3f9 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:07.894716 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-e7250ad8-e9b4-4da5-bf55-0f579ebba3f9 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab371128e42444f49bc63661feaf7cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ed089c81294b4981046ede5ed951bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:07.908985 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-e7250ad8-e9b4-4da5-bf55-0f579ebba3f9 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] 10.222.0.49 "GET /compute/v2.1/servers/6809f21a-9df9-499a-aec9-c628d50b64e3" status: 200 len: 1514 microversion: 2.1 time: 0.413572 May 12 14:52:07.909649 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 247/523] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:52:07 2022] GET /compute/v2.1/servers/6809f21a-9df9-499a-aec9-c628d50b64e3 => generated 1514 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:52:08.300177 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-ef214cb9-e78e-4561-b233-417cb29f45e6 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:08.301465 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-ef214cb9-e78e-4561-b233-417cb29f45e6 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 3062e66d-4c2a-4212-b186-ecafec6bde2e] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:52:08.310592 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-ef214cb9-e78e-4561-b233-417cb29f45e6 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:08.311308 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-ef214cb9-e78e-4561-b233-417cb29f45e6 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:08.320739 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-ef214cb9-e78e-4561-b233-417cb29f45e6 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:08.320739 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-ef214cb9-e78e-4561-b233-417cb29f45e6 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:08.329982 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-89c12e03-7e3f-4dfe-97c5-6bc243bc69d3 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:08.330606 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-89c12e03-7e3f-4dfe-97c5-6bc243bc69d3 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:52:08.347353 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-89c12e03-7e3f-4dfe-97c5-6bc243bc69d3 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:08.347800 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-89c12e03-7e3f-4dfe-97c5-6bc243bc69d3 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:08.348586 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-89c12e03-7e3f-4dfe-97c5-6bc243bc69d3 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:08.349019 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-89c12e03-7e3f-4dfe-97c5-6bc243bc69d3 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:08.756595 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-ef214cb9-e78e-4561-b233-417cb29f45e6 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e128ca83d6448c9ab1fe7dcc5467d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a090a68e336b4562aca524a95f550e04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:08.767724 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-ef214cb9-e78e-4561-b233-417cb29f45e6 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e" status: 200 len: 1679 microversion: 2.1 time: 0.471196 May 12 14:52:08.769064 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 277/524] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:52:08 2022] GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e => generated 1679 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:52:08.774997 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-25b7b929-b78a-4190-8317-23e95dc19c82 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:08.775821 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-25b7b929-b78a-4190-8317-23e95dc19c82 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:52:08.784800 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-25b7b929-b78a-4190-8317-23e95dc19c82 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:08.785493 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-25b7b929-b78a-4190-8317-23e95dc19c82 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:08.786436 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-25b7b929-b78a-4190-8317-23e95dc19c82 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:08.787052 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-25b7b929-b78a-4190-8317-23e95dc19c82 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:08.827368 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-89c12e03-7e3f-4dfe-97c5-6bc243bc69d3 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:08.843568 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-89c12e03-7e3f-4dfe-97c5-6bc243bc69d3 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:08.845674 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-89c12e03-7e3f-4dfe-97c5-6bc243bc69d3 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:08.847102 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-89c12e03-7e3f-4dfe-97c5-6bc243bc69d3 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9" status: 200 len: 1808 microversion: 2.20 time: 0.522155 May 12 14:52:08.859657 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 248/525] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:52:08 2022] GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9 => generated 1808 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:52:08.873238 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.wsgi [None req-25b7b929-b78a-4190-8317-23e95dc19c82 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] HTTP exception thrown: Instance 64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7 could not be found. May 12 14:52:08.874668 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-25b7b929-b78a-4190-8317-23e95dc19c82 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Returning 404 to user: Instance 64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7 could not be found. {{(pid=102213) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 12 14:52:08.876053 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-25b7b929-b78a-4190-8317-23e95dc19c82 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7" status: 404 len: 111 microversion: 2.1 time: 0.105854 May 12 14:52:08.877688 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 278/526] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:52:08 2022] GET /compute/v2.1/servers/64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 14:52:08.900757 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-0d7d84d8-ac28-4586-833f-d251e7f480ae tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '.version_select at 0x7ff77fbdb8b0>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:08.927606 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-8f8c1aaa-6358-445d-b3e2-7a46f98cee17 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:08.928491 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-8f8c1aaa-6358-445d-b3e2-7a46f98cee17 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] [instance: 6809f21a-9df9-499a-aec9-c628d50b64e3] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:52:08.956480 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-8f8c1aaa-6358-445d-b3e2-7a46f98cee17 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:08.957507 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-8f8c1aaa-6358-445d-b3e2-7a46f98cee17 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:08.959806 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-8f8c1aaa-6358-445d-b3e2-7a46f98cee17 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:08.960492 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-8f8c1aaa-6358-445d-b3e2-7a46f98cee17 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:09.089465 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-8f8c1aaa-6358-445d-b3e2-7a46f98cee17 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab371128e42444f49bc63661feaf7cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ed089c81294b4981046ede5ed951bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:09.106167 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-8f8c1aaa-6358-445d-b3e2-7a46f98cee17 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] 10.222.0.49 "GET /compute/v2.1/servers/6809f21a-9df9-499a-aec9-c628d50b64e3" status: 200 len: 1472 microversion: 2.1 time: 0.182652 May 12 14:52:09.116798 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 279/527] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:52:08 2022] GET /compute/v2.1/servers/6809f21a-9df9-499a-aec9-c628d50b64e3 => generated 1472 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:52:09.120781 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [req-e2b798f2-4bae-446a-be3e-0cde3c33e2fa req-c2a0787d-7cd1-4f4c-bbae-019209d85b1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6809f21a-9df9-499a-aec9-c628d50b64e3", "name": "network-vif-deleted", "tag": "89a9ff10-8343-460a-9e65-0158c87f5841"}]} {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:52:09.122966 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:52:09.122966 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: warnings.warn(msg) May 12 14:52:09.145826 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [req-e2b798f2-4bae-446a-be3e-0cde3c33e2fa req-c2a0787d-7cd1-4f4c-bbae-019209d85b1c service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:09.155240 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [req-e2b798f2-4bae-446a-be3e-0cde3c33e2fa req-c2a0787d-7cd1-4f4c-bbae-019209d85b1c service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:09.179364 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.compute.server_external_events [req-e2b798f2-4bae-446a-be3e-0cde3c33e2fa req-c2a0787d-7cd1-4f4c-bbae-019209d85b1c service nova] Creating event network-vif-deleted:89a9ff10-8343-460a-9e65-0158c87f5841 for instance 6809f21a-9df9-499a-aec9-c628d50b64e3 on hv-cinder-83118 May 12 14:52:09.204460 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [req-e2b798f2-4bae-446a-be3e-0cde3c33e2fa req-c2a0787d-7cd1-4f4c-bbae-019209d85b1c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092328 May 12 14:52:09.205554 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 280/528] 10.222.0.49 () {64 vars in 1317 bytes} [Thu May 12 14:52:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:52:09.207628 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-0d7d84d8-ac28-4586-833f-d251e7f480ae tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1319823142" status: 202 len: 0 microversion: 2.1 time: 0.311487 May 12 14:52:09.208528 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 249/529] 10.222.0.49 () {58 vars in 1220 bytes} [Thu May 12 14:52:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1319823142 => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 14:52:09.484458 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-e9398c28-a173-4c08-99cd-1db3d56d71c5 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "88e73d66-9d0e-4fcd-8b2d-61400be6ff03"}} {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:52:09.485767 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-e9398c28-a173-4c08-99cd-1db3d56d71c5 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 944e4e2e-d09f-4dd7-ac42-b037b09dc7c3] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:52:09.499490 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e9398c28-a173-4c08-99cd-1db3d56d71c5 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:09.499938 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e9398c28-a173-4c08-99cd-1db3d56d71c5 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:09.501046 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e9398c28-a173-4c08-99cd-1db3d56d71c5 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:09.501752 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e9398c28-a173-4c08-99cd-1db3d56d71c5 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:09.790761 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-f65e15d2-f9e8-4b6c-b710-4b0126dc3f62 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:09.792463 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-f65e15d2-f9e8-4b6c-b710-4b0126dc3f62 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 3062e66d-4c2a-4212-b186-ecafec6bde2e] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:52:09.803472 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-f65e15d2-f9e8-4b6c-b710-4b0126dc3f62 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:09.804226 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-f65e15d2-f9e8-4b6c-b710-4b0126dc3f62 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:09.805059 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-f65e15d2-f9e8-4b6c-b710-4b0126dc3f62 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:09.805543 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-f65e15d2-f9e8-4b6c-b710-4b0126dc3f62 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:10.027866 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-f65e15d2-f9e8-4b6c-b710-4b0126dc3f62 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e128ca83d6448c9ab1fe7dcc5467d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a090a68e336b4562aca524a95f550e04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:10.036831 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-f65e15d2-f9e8-4b6c-b710-4b0126dc3f62 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e" status: 200 len: 1679 microversion: 2.1 time: 0.251744 May 12 14:52:10.039023 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 250/530] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:52:09 2022] GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e => generated 1679 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:52:10.042055 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-0e61604d-0b6d-41e0-a280-927020900adb tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:10.042663 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-0e61604d-0b6d-41e0-a280-927020900adb tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:52:10.049869 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-0e61604d-0b6d-41e0-a280-927020900adb tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:10.050325 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-0e61604d-0b6d-41e0-a280-927020900adb tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:10.051144 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-0e61604d-0b6d-41e0-a280-927020900adb tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:10.051574 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-0e61604d-0b6d-41e0-a280-927020900adb tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:10.297230 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-0e61604d-0b6d-41e0-a280-927020900adb tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:10.307345 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-0e61604d-0b6d-41e0-a280-927020900adb tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:10.310799 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-0e61604d-0b6d-41e0-a280-927020900adb tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:10.310799 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-0e61604d-0b6d-41e0-a280-927020900adb tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9" status: 200 len: 1808 microversion: 2.20 time: 0.271741 May 12 14:52:10.319464 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 251/531] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:52:10 2022] GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9 => generated 1808 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:52:10.327134 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-93aba97c-f8fc-42f6-b89d-b37b38bbbece tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:10.327754 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-93aba97c-f8fc-42f6-b89d-b37b38bbbece tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] [instance: 6809f21a-9df9-499a-aec9-c628d50b64e3] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:52:10.336767 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-93aba97c-f8fc-42f6-b89d-b37b38bbbece tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:10.336767 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-93aba97c-f8fc-42f6-b89d-b37b38bbbece tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:10.346595 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-93aba97c-f8fc-42f6-b89d-b37b38bbbece tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:10.346595 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-93aba97c-f8fc-42f6-b89d-b37b38bbbece tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:10.743898 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-93aba97c-f8fc-42f6-b89d-b37b38bbbece tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab371128e42444f49bc63661feaf7cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ed089c81294b4981046ede5ed951bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:10.754217 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-93aba97c-f8fc-42f6-b89d-b37b38bbbece tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] 10.222.0.49 "GET /compute/v2.1/servers/6809f21a-9df9-499a-aec9-c628d50b64e3" status: 200 len: 1472 microversion: 2.1 time: 0.430355 May 12 14:52:10.755277 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 252/532] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:52:10 2022] GET /compute/v2.1/servers/6809f21a-9df9-499a-aec9-c628d50b64e3 => generated 1472 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:52:11.053368 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-cc7777b0-414c-497e-94af-da02fd2b9de0 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:11.054730 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-cc7777b0-414c-497e-94af-da02fd2b9de0 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 3062e66d-4c2a-4212-b186-ecafec6bde2e] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:52:11.062723 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-cc7777b0-414c-497e-94af-da02fd2b9de0 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:11.070000 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-cc7777b0-414c-497e-94af-da02fd2b9de0 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:11.070000 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-cc7777b0-414c-497e-94af-da02fd2b9de0 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:11.070000 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-cc7777b0-414c-497e-94af-da02fd2b9de0 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:11.357860 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-cc7777b0-414c-497e-94af-da02fd2b9de0 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e128ca83d6448c9ab1fe7dcc5467d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a090a68e336b4562aca524a95f550e04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:11.373185 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-cc7777b0-414c-497e-94af-da02fd2b9de0 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e" status: 200 len: 1679 microversion: 2.1 time: 0.323522 May 12 14:52:11.384408 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 253/533] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:52:11 2022] GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e => generated 1679 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:52:11.384408 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-52599a63-df96-46b0-b7e6-46cd3612ab3e tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:11.384408 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-52599a63-df96-46b0-b7e6-46cd3612ab3e tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:52:11.390181 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-52599a63-df96-46b0-b7e6-46cd3612ab3e tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:11.390638 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-52599a63-df96-46b0-b7e6-46cd3612ab3e tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:11.391468 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-52599a63-df96-46b0-b7e6-46cd3612ab3e tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:11.392019 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-52599a63-df96-46b0-b7e6-46cd3612ab3e tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:11.785576 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-52599a63-df96-46b0-b7e6-46cd3612ab3e tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:11.800553 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-52599a63-df96-46b0-b7e6-46cd3612ab3e tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:11.802091 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-52599a63-df96-46b0-b7e6-46cd3612ab3e tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:11.807917 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-52599a63-df96-46b0-b7e6-46cd3612ab3e tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9" status: 200 len: 1808 microversion: 2.20 time: 0.429149 May 12 14:52:11.807917 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 254/534] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:52:11 2022] GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9 => generated 1808 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:52:11.809450 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-c6dee2bd-3d00-4c19-87bb-ffa26f709895 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Action: 'create', calling method: .version_select at 0x7ff77e52c940>, body: {"keypair": {"name": "tempest-keypair-1884114003", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPiTe3TLI6LKvESlXLyeVQ0AC3/7zCMefuSQk+3uA0suIizbA24E6HcVDuMqWly8Q+YD88llLJ1m3te1Z0Sc+9l+s7xek0Hj6kvH831/svvMDe+8RQKWVcIrEPu0VMmlbA=="}} {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:52:11.838173 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.quota [None req-c6dee2bd-3d00-4c19-87bb-ffa26f709895 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Getting quotas for project 67a8451272cc41ebaf1598ed940bf09a. Resources: {'key_pairs'} {{(pid=102212) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 12 14:52:11.844902 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.quota [None req-c6dee2bd-3d00-4c19-87bb-ffa26f709895 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Getting quotas for user 6a641a08648b454780081ecc2e291066 and project 67a8451272cc41ebaf1598ed940bf09a. Resources: {'key_pairs'} {{(pid=102212) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 12 14:52:12.210199 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-c6dee2bd-3d00-4c19-87bb-ffa26f709895 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.403327 May 12 14:52:12.210925 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 255/535] 10.222.0.49 () {60 vars in 1158 bytes} [Thu May 12 14:52:11 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:52:12.216546 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-2fd00d9e-053e-4251-ac34-33acaef75e98 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:12.216546 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-2fd00d9e-053e-4251-ac34-33acaef75e98 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] [instance: 6809f21a-9df9-499a-aec9-c628d50b64e3] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:52:12.226883 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-2fd00d9e-053e-4251-ac34-33acaef75e98 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:12.227477 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-2fd00d9e-053e-4251-ac34-33acaef75e98 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:12.228645 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-2fd00d9e-053e-4251-ac34-33acaef75e98 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:12.229499 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-2fd00d9e-053e-4251-ac34-33acaef75e98 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:12.386162 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-2fd00d9e-053e-4251-ac34-33acaef75e98 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab371128e42444f49bc63661feaf7cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ed089c81294b4981046ede5ed951bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:12.400132 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-2fd00d9e-053e-4251-ac34-33acaef75e98 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] 10.222.0.49 "GET /compute/v2.1/servers/6809f21a-9df9-499a-aec9-c628d50b64e3" status: 200 len: 1472 microversion: 2.1 time: 0.188189 May 12 14:52:12.402599 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 256/536] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:52:12 2022] GET /compute/v2.1/servers/6809f21a-9df9-499a-aec9-c628d50b64e3 => generated 1472 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:52:12.415306 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-51fdd4ce-b55e-46c1-b945-19562fb3ff5c tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:12.418379 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-51fdd4ce-b55e-46c1-b945-19562fb3ff5c tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 3062e66d-4c2a-4212-b186-ecafec6bde2e] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:52:12.426341 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-51fdd4ce-b55e-46c1-b945-19562fb3ff5c tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:12.426924 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-51fdd4ce-b55e-46c1-b945-19562fb3ff5c tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:12.427988 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-51fdd4ce-b55e-46c1-b945-19562fb3ff5c tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:12.428427 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-51fdd4ce-b55e-46c1-b945-19562fb3ff5c tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:12.661795 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-51fdd4ce-b55e-46c1-b945-19562fb3ff5c tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e128ca83d6448c9ab1fe7dcc5467d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a090a68e336b4562aca524a95f550e04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:12.677587 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-51fdd4ce-b55e-46c1-b945-19562fb3ff5c tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e" status: 200 len: 1679 microversion: 2.1 time: 0.274847 May 12 14:52:12.694415 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 257/537] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:52:12 2022] GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e => generated 1679 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:52:12.826194 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-b21e9b1a-e0ac-4d0d-b569-20fd5849e155 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:12.834645 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-b21e9b1a-e0ac-4d0d-b569-20fd5849e155 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:52:12.834645 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-b21e9b1a-e0ac-4d0d-b569-20fd5849e155 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:12.834967 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-b21e9b1a-e0ac-4d0d-b569-20fd5849e155 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:12.835738 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-b21e9b1a-e0ac-4d0d-b569-20fd5849e155 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:12.836173 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-b21e9b1a-e0ac-4d0d-b569-20fd5849e155 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:13.174497 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-b21e9b1a-e0ac-4d0d-b569-20fd5849e155 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:13.184460 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-b21e9b1a-e0ac-4d0d-b569-20fd5849e155 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:13.185968 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-b21e9b1a-e0ac-4d0d-b569-20fd5849e155 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:13.187283 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-b21e9b1a-e0ac-4d0d-b569-20fd5849e155 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9" status: 200 len: 1808 microversion: 2.20 time: 0.366782 May 12 14:52:13.197398 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 258/538] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:52:12 2022] GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9 => generated 1808 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:52:13.417956 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-b9682acb-a150-4eee-8868-186eeff65422 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:13.419536 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-b9682acb-a150-4eee-8868-186eeff65422 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] [instance: 6809f21a-9df9-499a-aec9-c628d50b64e3] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:52:13.430310 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-b9682acb-a150-4eee-8868-186eeff65422 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:13.431010 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-b9682acb-a150-4eee-8868-186eeff65422 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:13.432019 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-b9682acb-a150-4eee-8868-186eeff65422 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:13.432635 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-b9682acb-a150-4eee-8868-186eeff65422 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:13.577956 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-b9682acb-a150-4eee-8868-186eeff65422 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab371128e42444f49bc63661feaf7cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ed089c81294b4981046ede5ed951bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:13.606363 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-b9682acb-a150-4eee-8868-186eeff65422 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] 10.222.0.49 "GET /compute/v2.1/servers/6809f21a-9df9-499a-aec9-c628d50b64e3" status: 200 len: 1472 microversion: 2.1 time: 0.169067 May 12 14:52:13.606363 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 259/539] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:52:13 2022] GET /compute/v2.1/servers/6809f21a-9df9-499a-aec9-c628d50b64e3 => generated 1472 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:52:13.695767 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-84d97737-7f1d-4566-af29-cae53420d390 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:13.696428 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-84d97737-7f1d-4566-af29-cae53420d390 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 3062e66d-4c2a-4212-b186-ecafec6bde2e] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:52:13.703828 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-84d97737-7f1d-4566-af29-cae53420d390 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:13.704274 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-84d97737-7f1d-4566-af29-cae53420d390 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:13.705079 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-84d97737-7f1d-4566-af29-cae53420d390 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:13.705515 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-84d97737-7f1d-4566-af29-cae53420d390 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:13.971204 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-84d97737-7f1d-4566-af29-cae53420d390 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e128ca83d6448c9ab1fe7dcc5467d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a090a68e336b4562aca524a95f550e04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:13.980110 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-84d97737-7f1d-4566-af29-cae53420d390 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e" status: 200 len: 1679 microversion: 2.1 time: 0.288192 May 12 14:52:13.997171 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 260/540] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:52:13 2022] GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e => generated 1679 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:52:14.206112 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-2b46ce6b-3f8f-474f-ac79-573098f182f0 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:14.207978 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-2b46ce6b-3f8f-474f-ac79-573098f182f0 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:52:14.226737 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-2b46ce6b-3f8f-474f-ac79-573098f182f0 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:14.227338 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-2b46ce6b-3f8f-474f-ac79-573098f182f0 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:14.229121 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-2b46ce6b-3f8f-474f-ac79-573098f182f0 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:14.231730 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-2b46ce6b-3f8f-474f-ac79-573098f182f0 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:14.531666 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-2b46ce6b-3f8f-474f-ac79-573098f182f0 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:14.541818 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-2b46ce6b-3f8f-474f-ac79-573098f182f0 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:14.543354 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-2b46ce6b-3f8f-474f-ac79-573098f182f0 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:14.544497 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-2b46ce6b-3f8f-474f-ac79-573098f182f0 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9" status: 200 len: 1808 microversion: 2.20 time: 0.342642 May 12 14:52:14.545279 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 261/541] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:52:14 2022] GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9 => generated 1808 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:52:14.602285 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-381807ce-0a76-4642-8eb8-88d2f9eb9860 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:14.603112 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-381807ce-0a76-4642-8eb8-88d2f9eb9860 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] [instance: 6809f21a-9df9-499a-aec9-c628d50b64e3] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:52:14.610203 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-381807ce-0a76-4642-8eb8-88d2f9eb9860 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:14.610650 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-381807ce-0a76-4642-8eb8-88d2f9eb9860 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:14.611468 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-381807ce-0a76-4642-8eb8-88d2f9eb9860 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:14.614843 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-381807ce-0a76-4642-8eb8-88d2f9eb9860 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:14.741285 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-381807ce-0a76-4642-8eb8-88d2f9eb9860 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab371128e42444f49bc63661feaf7cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ed089c81294b4981046ede5ed951bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:14.753635 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-381807ce-0a76-4642-8eb8-88d2f9eb9860 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] 10.222.0.49 "GET /compute/v2.1/servers/6809f21a-9df9-499a-aec9-c628d50b64e3" status: 200 len: 1472 microversion: 2.1 time: 0.154974 May 12 14:52:14.760714 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 262/542] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:52:14 2022] GET /compute/v2.1/servers/6809f21a-9df9-499a-aec9-c628d50b64e3 => generated 1472 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:52:14.998286 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-0f8e3c64-d189-45e2-becc-0fdae0fcaba0 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:14.998286 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-0f8e3c64-d189-45e2-becc-0fdae0fcaba0 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 3062e66d-4c2a-4212-b186-ecafec6bde2e] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:52:15.015758 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-0f8e3c64-d189-45e2-becc-0fdae0fcaba0 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:15.016220 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-0f8e3c64-d189-45e2-becc-0fdae0fcaba0 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:15.017019 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-0f8e3c64-d189-45e2-becc-0fdae0fcaba0 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:15.017457 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-0f8e3c64-d189-45e2-becc-0fdae0fcaba0 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:15.327147 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-0f8e3c64-d189-45e2-becc-0fdae0fcaba0 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e128ca83d6448c9ab1fe7dcc5467d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a090a68e336b4562aca524a95f550e04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:15.336283 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-0f8e3c64-d189-45e2-becc-0fdae0fcaba0 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e" status: 200 len: 1679 microversion: 2.1 time: 0.342505 May 12 14:52:15.336850 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 263/543] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:52:14 2022] GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e => generated 1679 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:52:15.563971 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-19c0fdee-62b6-41c8-97a4-ec16e78d6b79 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:15.564749 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-19c0fdee-62b6-41c8-97a4-ec16e78d6b79 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:52:15.572525 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-19c0fdee-62b6-41c8-97a4-ec16e78d6b79 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:15.572967 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-19c0fdee-62b6-41c8-97a4-ec16e78d6b79 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:15.573737 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-19c0fdee-62b6-41c8-97a4-ec16e78d6b79 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:15.574164 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-19c0fdee-62b6-41c8-97a4-ec16e78d6b79 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:15.899047 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-19c0fdee-62b6-41c8-97a4-ec16e78d6b79 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:15.912546 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-19c0fdee-62b6-41c8-97a4-ec16e78d6b79 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:15.913930 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-19c0fdee-62b6-41c8-97a4-ec16e78d6b79 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:15.915254 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-19c0fdee-62b6-41c8-97a4-ec16e78d6b79 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9" status: 200 len: 1808 microversion: 2.20 time: 0.355273 May 12 14:52:15.916037 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 264/544] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:52:15 2022] GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9 => generated 1808 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 14:52:15.920485 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-ba5b28c5-4f8f-4edd-90f8-8ac7776c5f0c tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:15.921105 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-ba5b28c5-4f8f-4edd-90f8-8ac7776c5f0c tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] [instance: 6809f21a-9df9-499a-aec9-c628d50b64e3] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:52:15.930123 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-ba5b28c5-4f8f-4edd-90f8-8ac7776c5f0c tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:15.930580 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-ba5b28c5-4f8f-4edd-90f8-8ac7776c5f0c tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:15.931406 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-ba5b28c5-4f8f-4edd-90f8-8ac7776c5f0c tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:15.931863 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-ba5b28c5-4f8f-4edd-90f8-8ac7776c5f0c tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:16.071108 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-ba5b28c5-4f8f-4edd-90f8-8ac7776c5f0c tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab371128e42444f49bc63661feaf7cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ed089c81294b4981046ede5ed951bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:16.084459 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-ba5b28c5-4f8f-4edd-90f8-8ac7776c5f0c tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] 10.222.0.49 "GET /compute/v2.1/servers/6809f21a-9df9-499a-aec9-c628d50b64e3" status: 200 len: 1472 microversion: 2.1 time: 0.166210 May 12 14:52:16.085094 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 265/545] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:52:15 2022] GET /compute/v2.1/servers/6809f21a-9df9-499a-aec9-c628d50b64e3 => generated 1472 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:52:16.353825 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-aa6e3583-8ef5-4867-92d9-98292a5bd3f0 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:16.354438 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-aa6e3583-8ef5-4867-92d9-98292a5bd3f0 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 3062e66d-4c2a-4212-b186-ecafec6bde2e] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:52:16.361897 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-aa6e3583-8ef5-4867-92d9-98292a5bd3f0 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:16.362349 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-aa6e3583-8ef5-4867-92d9-98292a5bd3f0 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:16.363151 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-aa6e3583-8ef5-4867-92d9-98292a5bd3f0 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:16.363585 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-aa6e3583-8ef5-4867-92d9-98292a5bd3f0 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:16.650849 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-aa6e3583-8ef5-4867-92d9-98292a5bd3f0 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e128ca83d6448c9ab1fe7dcc5467d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a090a68e336b4562aca524a95f550e04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:16.659328 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-aa6e3583-8ef5-4867-92d9-98292a5bd3f0 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e" status: 200 len: 1679 microversion: 2.1 time: 0.309744 May 12 14:52:16.659888 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 266/546] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:52:16 2022] GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e => generated 1679 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:52:16.933266 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-b69fb98b-8e05-4a12-a034-fad04fa0ec57 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:16.933870 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-b69fb98b-8e05-4a12-a034-fad04fa0ec57 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:52:16.941164 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-b69fb98b-8e05-4a12-a034-fad04fa0ec57 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:16.941608 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-b69fb98b-8e05-4a12-a034-fad04fa0ec57 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:16.942376 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-b69fb98b-8e05-4a12-a034-fad04fa0ec57 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:16.942800 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-b69fb98b-8e05-4a12-a034-fad04fa0ec57 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:17.165008 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-b69fb98b-8e05-4a12-a034-fad04fa0ec57 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:17.174397 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-b69fb98b-8e05-4a12-a034-fad04fa0ec57 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:17.175893 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-b69fb98b-8e05-4a12-a034-fad04fa0ec57 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:17.177042 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-b69fb98b-8e05-4a12-a034-fad04fa0ec57 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9" status: 200 len: 1808 microversion: 2.20 time: 0.247454 May 12 14:52:17.177590 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 267/547] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:52:16 2022] GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9 => generated 1808 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:52:17.186401 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-0b2d7438-31be-4b81-a635-3ac7c9487be3 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-868334327", "imageRef": "a4587ab2-5f51-46a3-a023-0e6778ccaaa1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9862f13a-dccf-465d-abda-f29b2d232c04"}], "security_groups": [{"name": "tempest-securitygroup--1130495193"}], "key_name": "tempest-keypair-1884114003", "user_data": "}} {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:52:17.380185 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.network.neutron [None req-0b2d7438-31be-4b81-a635-3ac7c9487be3 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] validate_networks() for [('9862f13a-dccf-465d-abda-f29b2d232c04', None, None, None)] {{(pid=102212) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} May 12 14:52:17.978760 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.virt.hardware [None req-0b2d7438-31be-4b81-a635-3ac7c9487be3 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Flavor limits 0:0:0 {{(pid=102212) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 14:52:17.979409 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.virt.hardware [None req-0b2d7438-31be-4b81-a635-3ac7c9487be3 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Image limits 0:0:0 {{(pid=102212) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 14:52:17.979726 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.virt.hardware [None req-0b2d7438-31be-4b81-a635-3ac7c9487be3 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Flavor pref 0:0:0 {{(pid=102212) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 14:52:17.980140 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.virt.hardware [None req-0b2d7438-31be-4b81-a635-3ac7c9487be3 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Image pref 0:0:0 {{(pid=102212) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 14:52:17.980556 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.virt.hardware [None req-0b2d7438-31be-4b81-a635-3ac7c9487be3 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=102212) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 14:52:17.988889 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-0b2d7438-31be-4b81-a635-3ac7c9487be3 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:17.989336 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-0b2d7438-31be-4b81-a635-3ac7c9487be3 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:17.990139 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-0b2d7438-31be-4b81-a635-3ac7c9487be3 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:17.990579 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-0b2d7438-31be-4b81-a635-3ac7c9487be3 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:18.007807 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.quota [None req-0b2d7438-31be-4b81-a635-3ac7c9487be3 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Getting quotas for project 67a8451272cc41ebaf1598ed940bf09a. Resources: {'cores', 'ram', 'instances'} {{(pid=102212) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 12 14:52:18.011735 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.quota [None req-0b2d7438-31be-4b81-a635-3ac7c9487be3 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Getting quotas for user 6a641a08648b454780081ecc2e291066 and project 67a8451272cc41ebaf1598ed940bf09a. Resources: {'cores', 'ram', 'instances'} {{(pid=102212) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 12 14:52:18.023072 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-0b2d7438-31be-4b81-a635-3ac7c9487be3 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Going to run 1 instances... {{(pid=102212) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 12 14:52:18.025329 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-0b2d7438-31be-4b81-a635-3ac7c9487be3 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 6f7de537-3c2b-4b45-a0da-e5b9ab7c169a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a4587ab2-5f51-46a3-a023-0e6778ccaaa1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=102212) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} May 12 14:52:18.152636 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-0b2d7438-31be-4b81-a635-3ac7c9487be3 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.973830 May 12 14:52:18.153276 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 268/548] 10.222.0.49 () {60 vars in 1146 bytes} [Thu May 12 14:52:17 2022] POST /compute/v2.1/servers => generated 402 bytes in 975 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 14:52:18.162057 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-6d16e0e2-6b8a-4579-bcaf-727b7dac37d5 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:18.162680 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-6d16e0e2-6b8a-4579-bcaf-727b7dac37d5 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] [instance: 6809f21a-9df9-499a-aec9-c628d50b64e3] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:52:18.170432 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-6d16e0e2-6b8a-4579-bcaf-727b7dac37d5 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:18.176717 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-6d16e0e2-6b8a-4579-bcaf-727b7dac37d5 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:18.176717 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-6d16e0e2-6b8a-4579-bcaf-727b7dac37d5 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:18.176717 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-6d16e0e2-6b8a-4579-bcaf-727b7dac37d5 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:18.290775 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-6d16e0e2-6b8a-4579-bcaf-727b7dac37d5 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab371128e42444f49bc63661feaf7cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ed089c81294b4981046ede5ed951bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:18.309175 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-6d16e0e2-6b8a-4579-bcaf-727b7dac37d5 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] 10.222.0.49 "GET /compute/v2.1/servers/6809f21a-9df9-499a-aec9-c628d50b64e3" status: 200 len: 1472 microversion: 2.1 time: 0.144523 May 12 14:52:18.309175 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 269/549] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:52:18 2022] GET /compute/v2.1/servers/6809f21a-9df9-499a-aec9-c628d50b64e3 => generated 1472 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:52:18.309175 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-9daad6ea-ef02-4095-ae1c-f84fdbd95119 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:18.309175 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-9daad6ea-ef02-4095-ae1c-f84fdbd95119 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 3062e66d-4c2a-4212-b186-ecafec6bde2e] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:52:18.313605 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-9daad6ea-ef02-4095-ae1c-f84fdbd95119 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:18.314173 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-9daad6ea-ef02-4095-ae1c-f84fdbd95119 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:18.315032 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-9daad6ea-ef02-4095-ae1c-f84fdbd95119 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:18.315464 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-9daad6ea-ef02-4095-ae1c-f84fdbd95119 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:18.505405 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-9daad6ea-ef02-4095-ae1c-f84fdbd95119 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e128ca83d6448c9ab1fe7dcc5467d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a090a68e336b4562aca524a95f550e04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:18.513477 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-9daad6ea-ef02-4095-ae1c-f84fdbd95119 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e" status: 200 len: 1679 microversion: 2.1 time: 0.213042 May 12 14:52:18.514038 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 270/550] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:52:18 2022] GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e => generated 1679 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:52:18.518236 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-5c55eb37-22d9-4aaf-8cc4-3159ca17170f tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:18.518854 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-5c55eb37-22d9-4aaf-8cc4-3159ca17170f tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 6f7de537-3c2b-4b45-a0da-e5b9ab7c169a] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:52:18.589509 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-5c55eb37-22d9-4aaf-8cc4-3159ca17170f tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a641a08648b454780081ecc2e291066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a8451272cc41ebaf1598ed940bf09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:18.596946 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-5c55eb37-22d9-4aaf-8cc4-3159ca17170f tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/6f7de537-3c2b-4b45-a0da-e5b9ab7c169a" status: 200 len: 1241 microversion: 2.1 time: 0.081971 May 12 14:52:18.597509 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 271/551] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:52:18 2022] GET /compute/v2.1/servers/6f7de537-3c2b-4b45-a0da-e5b9ab7c169a => generated 1241 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:52:18.602307 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-a2c069dc-6849-42f3-9485-b18bb4b548db tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:18.603026 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-a2c069dc-6849-42f3-9485-b18bb4b548db tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:52:18.610310 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-a2c069dc-6849-42f3-9485-b18bb4b548db tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:18.610756 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-a2c069dc-6849-42f3-9485-b18bb4b548db tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:18.611587 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-a2c069dc-6849-42f3-9485-b18bb4b548db tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:18.612031 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-a2c069dc-6849-42f3-9485-b18bb4b548db tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:18.808364 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-a2c069dc-6849-42f3-9485-b18bb4b548db tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:18.817397 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-a2c069dc-6849-42f3-9485-b18bb4b548db tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:18.818908 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-a2c069dc-6849-42f3-9485-b18bb4b548db tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:18.820017 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-a2c069dc-6849-42f3-9485-b18bb4b548db tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9" status: 200 len: 1808 microversion: 2.20 time: 0.221601 May 12 14:52:18.820569 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 272/552] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:52:18 2022] GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9 => generated 1808 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:52:19.317699 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-54c837c7-f358-4e7d-a2c0-b013d23a9213 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:19.318898 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-54c837c7-f358-4e7d-a2c0-b013d23a9213 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] [instance: 6809f21a-9df9-499a-aec9-c628d50b64e3] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:52:19.328226 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-54c837c7-f358-4e7d-a2c0-b013d23a9213 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:19.328723 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-54c837c7-f358-4e7d-a2c0-b013d23a9213 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:19.329716 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-54c837c7-f358-4e7d-a2c0-b013d23a9213 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:19.330257 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-54c837c7-f358-4e7d-a2c0-b013d23a9213 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:19.404208 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-54c837c7-f358-4e7d-a2c0-b013d23a9213 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:19.404583 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-54c837c7-f358-4e7d-a2c0-b013d23a9213 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:19.405032 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.objects.instance [None req-54c837c7-f358-4e7d-a2c0-b013d23a9213 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lazy-loading 'fault' on Instance uuid 6809f21a-9df9-499a-aec9-c628d50b64e3 {{(pid=102212) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 12 14:52:19.461256 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-54c837c7-f358-4e7d-a2c0-b013d23a9213 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab371128e42444f49bc63661feaf7cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9ed089c81294b4981046ede5ed951bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:19.469371 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-54c837c7-f358-4e7d-a2c0-b013d23a9213 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] 10.222.0.49 "GET /compute/v2.1/servers/6809f21a-9df9-499a-aec9-c628d50b64e3" status: 200 len: 1309 microversion: 2.1 time: 0.156598 May 12 14:52:19.469937 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 273/553] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:52:19 2022] GET /compute/v2.1/servers/6809f21a-9df9-499a-aec9-c628d50b64e3 => generated 1309 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:52:19.530102 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-b9c9b5fc-6620-47df-bc7d-00f7ea83066b tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:19.530711 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-b9c9b5fc-6620-47df-bc7d-00f7ea83066b tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 3062e66d-4c2a-4212-b186-ecafec6bde2e] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:52:19.538343 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-b9c9b5fc-6620-47df-bc7d-00f7ea83066b tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:19.538792 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-b9c9b5fc-6620-47df-bc7d-00f7ea83066b tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:19.539590 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-b9c9b5fc-6620-47df-bc7d-00f7ea83066b tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:19.540055 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-b9c9b5fc-6620-47df-bc7d-00f7ea83066b tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:19.752726 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-b9c9b5fc-6620-47df-bc7d-00f7ea83066b tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e128ca83d6448c9ab1fe7dcc5467d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a090a68e336b4562aca524a95f550e04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:19.761840 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-b9c9b5fc-6620-47df-bc7d-00f7ea83066b tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e" status: 200 len: 1656 microversion: 2.1 time: 0.234981 May 12 14:52:19.762145 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 274/554] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:52:19 2022] GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e => generated 1656 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:52:19.766720 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-6ab7b50f-b1d7-4177-bb91-1ec3e7fc209a tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:19.767367 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-6ab7b50f-b1d7-4177-bb91-1ec3e7fc209a tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 6f7de537-3c2b-4b45-a0da-e5b9ab7c169a] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:52:19.775588 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-6ab7b50f-b1d7-4177-bb91-1ec3e7fc209a tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:19.776124 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-6ab7b50f-b1d7-4177-bb91-1ec3e7fc209a tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:19.776827 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-6ab7b50f-b1d7-4177-bb91-1ec3e7fc209a tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:19.783030 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-6ab7b50f-b1d7-4177-bb91-1ec3e7fc209a tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:19.908137 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-6ab7b50f-b1d7-4177-bb91-1ec3e7fc209a tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a641a08648b454780081ecc2e291066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a8451272cc41ebaf1598ed940bf09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:19.917864 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-6ab7b50f-b1d7-4177-bb91-1ec3e7fc209a tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/6f7de537-3c2b-4b45-a0da-e5b9ab7c169a" status: 200 len: 1237 microversion: 2.1 time: 0.154617 May 12 14:52:19.918915 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 275/555] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:52:19 2022] GET /compute/v2.1/servers/6f7de537-3c2b-4b45-a0da-e5b9ab7c169a => generated 1237 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:52:19.923646 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-42471392-feda-4cce-9da9-79908f4f25f2 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:52:19.932323 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-42471392-feda-4cce-9da9-79908f4f25f2 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:19.936444 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-42471392-feda-4cce-9da9-79908f4f25f2 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:20.003575 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-42471392-feda-4cce-9da9-79908f4f25f2 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 3062e66d-4c2a-4212-b186-ecafec6bde2e] Going to try to start instance {{(pid=102212) start /opt/stack/nova/nova/compute/api.py:2625}} May 12 14:52:20.109012 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-e9398c28-a173-4c08-99cd-1db3d56d71c5 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "POST /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 10.629663 May 12 14:52:20.109889 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 281/556] 10.222.0.49 () {60 vars in 1322 bytes} [Thu May 12 14:52:09 2022] POST /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3/os-volume_attachments => generated 194 bytes in 10632 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:52:20.116493 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-e501eb37-5f16-41e6-9f4b-7392571006cf tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:20.117484 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-e501eb37-5f16-41e6-9f4b-7392571006cf tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:52:20.135058 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e501eb37-5f16-41e6-9f4b-7392571006cf tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:20.135613 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e501eb37-5f16-41e6-9f4b-7392571006cf tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:20.137368 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e501eb37-5f16-41e6-9f4b-7392571006cf tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:20.137368 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e501eb37-5f16-41e6-9f4b-7392571006cf tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:20.363139 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-e501eb37-5f16-41e6-9f4b-7392571006cf tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:20.372399 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-e501eb37-5f16-41e6-9f4b-7392571006cf tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:20.375183 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-e501eb37-5f16-41e6-9f4b-7392571006cf tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:20.376348 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-e501eb37-5f16-41e6-9f4b-7392571006cf tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9" status: 200 len: 1808 microversion: 2.20 time: 0.265019 May 12 14:52:20.376904 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 282/557] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:52:20 2022] GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9 => generated 1808 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:52:20.428026 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-42471392-feda-4cce-9da9-79908f4f25f2 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "POST /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e/action" status: 202 len: 0 microversion: 2.1 time: 0.507569 May 12 14:52:20.442051 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 276/558] 10.222.0.49 () {60 vars in 1277 bytes} [Thu May 12 14:52:19 2022] POST /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e/action => generated 0 bytes in 509 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 14:52:20.443041 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-238b81bd-f386-478a-90b6-a01df4e50050 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:20.443041 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-238b81bd-f386-478a-90b6-a01df4e50050 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 3062e66d-4c2a-4212-b186-ecafec6bde2e] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:52:20.447092 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-238b81bd-f386-478a-90b6-a01df4e50050 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:20.447767 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-238b81bd-f386-478a-90b6-a01df4e50050 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:20.448558 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-238b81bd-f386-478a-90b6-a01df4e50050 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:20.448993 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-238b81bd-f386-478a-90b6-a01df4e50050 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:20.486645 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-4e8356a1-6a65-4504-9cb7-78b2633aa977 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:20.487474 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-4e8356a1-6a65-4504-9cb7-78b2633aa977 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] [instance: 6809f21a-9df9-499a-aec9-c628d50b64e3] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:52:20.495464 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-4e8356a1-6a65-4504-9cb7-78b2633aa977 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:20.495999 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-4e8356a1-6a65-4504-9cb7-78b2633aa977 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:20.497042 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-4e8356a1-6a65-4504-9cb7-78b2633aa977 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:20.497560 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-4e8356a1-6a65-4504-9cb7-78b2633aa977 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:20.548823 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.wsgi [None req-4e8356a1-6a65-4504-9cb7-78b2633aa977 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] HTTP exception thrown: Instance 6809f21a-9df9-499a-aec9-c628d50b64e3 could not be found. May 12 14:52:20.553176 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-4e8356a1-6a65-4504-9cb7-78b2633aa977 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] Returning 404 to user: Instance 6809f21a-9df9-499a-aec9-c628d50b64e3 could not be found. {{(pid=102212) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 12 14:52:20.553176 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-4e8356a1-6a65-4504-9cb7-78b2633aa977 tempest-VolumesSnapshotTestJSON-1901508701 tempest-VolumesSnapshotTestJSON-1901508701-project] 10.222.0.49 "GET /compute/v2.1/servers/6809f21a-9df9-499a-aec9-c628d50b64e3" status: 404 len: 111 microversion: 2.1 time: 0.068495 May 12 14:52:20.553176 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 277/559] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:52:20 2022] GET /compute/v2.1/servers/6809f21a-9df9-499a-aec9-c628d50b64e3 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 12 14:52:20.680025 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-238b81bd-f386-478a-90b6-a01df4e50050 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e128ca83d6448c9ab1fe7dcc5467d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a090a68e336b4562aca524a95f550e04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:20.688744 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-238b81bd-f386-478a-90b6-a01df4e50050 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e" status: 200 len: 1665 microversion: 2.1 time: 0.255301 May 12 14:52:20.695203 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 283/560] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:52:20 2022] GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e => generated 1665 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:52:20.936610 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-f678cb0d-996d-43b4-9e34-909a64390e53 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:20.937498 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-f678cb0d-996d-43b4-9e34-909a64390e53 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 6f7de537-3c2b-4b45-a0da-e5b9ab7c169a] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:52:20.946027 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-f678cb0d-996d-43b4-9e34-909a64390e53 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:20.952958 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-f678cb0d-996d-43b4-9e34-909a64390e53 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:20.952958 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-f678cb0d-996d-43b4-9e34-909a64390e53 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:20.952958 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-f678cb0d-996d-43b4-9e34-909a64390e53 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:21.072310 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-f678cb0d-996d-43b4-9e34-909a64390e53 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a641a08648b454780081ecc2e291066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a8451272cc41ebaf1598ed940bf09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:21.086485 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-f678cb0d-996d-43b4-9e34-909a64390e53 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/6f7de537-3c2b-4b45-a0da-e5b9ab7c169a" status: 200 len: 1293 microversion: 2.1 time: 0.153250 May 12 14:52:21.092280 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 278/561] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:52:20 2022] GET /compute/v2.1/servers/6f7de537-3c2b-4b45-a0da-e5b9ab7c169a => generated 1293 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:52:21.400238 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-6214bf6b-6e37-4d57-bc2f-054122ce9ffa tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:21.402659 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-6214bf6b-6e37-4d57-bc2f-054122ce9ffa tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:52:21.410804 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-6214bf6b-6e37-4d57-bc2f-054122ce9ffa tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:21.411592 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-6214bf6b-6e37-4d57-bc2f-054122ce9ffa tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:21.413150 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-6214bf6b-6e37-4d57-bc2f-054122ce9ffa tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:21.413813 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-6214bf6b-6e37-4d57-bc2f-054122ce9ffa tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:21.706767 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-9cf9efe8-0110-43d2-91db-d330fbb18eec tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:21.714770 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-9cf9efe8-0110-43d2-91db-d330fbb18eec tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 3062e66d-4c2a-4212-b186-ecafec6bde2e] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:52:21.716837 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-9cf9efe8-0110-43d2-91db-d330fbb18eec tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:21.717556 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-9cf9efe8-0110-43d2-91db-d330fbb18eec tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:21.718576 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-9cf9efe8-0110-43d2-91db-d330fbb18eec tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:21.719294 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-9cf9efe8-0110-43d2-91db-d330fbb18eec tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:21.832297 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-6214bf6b-6e37-4d57-bc2f-054122ce9ffa tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:21.842778 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-6214bf6b-6e37-4d57-bc2f-054122ce9ffa tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:21.845412 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-6214bf6b-6e37-4d57-bc2f-054122ce9ffa tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:21.846679 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-6214bf6b-6e37-4d57-bc2f-054122ce9ffa tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9" status: 200 len: 1808 microversion: 2.20 time: 0.450601 May 12 14:52:21.847673 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 284/562] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:52:21 2022] GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9 => generated 1808 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:52:21.975248 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-9cf9efe8-0110-43d2-91db-d330fbb18eec tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e128ca83d6448c9ab1fe7dcc5467d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a090a68e336b4562aca524a95f550e04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:21.984428 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-9cf9efe8-0110-43d2-91db-d330fbb18eec tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e" status: 200 len: 1665 microversion: 2.1 time: 0.281368 May 12 14:52:21.989323 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 279/563] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:52:21 2022] GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e => generated 1665 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:52:22.104660 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-375bc32c-6776-4960-ac6b-9d75db196015 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:22.105287 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-375bc32c-6776-4960-ac6b-9d75db196015 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 6f7de537-3c2b-4b45-a0da-e5b9ab7c169a] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:52:22.112552 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-375bc32c-6776-4960-ac6b-9d75db196015 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:22.112999 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-375bc32c-6776-4960-ac6b-9d75db196015 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:22.113859 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-375bc32c-6776-4960-ac6b-9d75db196015 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:22.114651 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-375bc32c-6776-4960-ac6b-9d75db196015 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:22.259378 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-375bc32c-6776-4960-ac6b-9d75db196015 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a641a08648b454780081ecc2e291066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a8451272cc41ebaf1598ed940bf09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:22.267487 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-375bc32c-6776-4960-ac6b-9d75db196015 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/6f7de537-3c2b-4b45-a0da-e5b9ab7c169a" status: 200 len: 1299 microversion: 2.1 time: 0.166988 May 12 14:52:22.268094 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 285/564] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:52:22 2022] GET /compute/v2.1/servers/6f7de537-3c2b-4b45-a0da-e5b9ab7c169a => generated 1299 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:52:22.867369 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-2931424b-ca65-4dbe-8869-6766c4ddd956 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:22.868017 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-2931424b-ca65-4dbe-8869-6766c4ddd956 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:52:22.879434 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-2931424b-ca65-4dbe-8869-6766c4ddd956 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:22.879434 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-2931424b-ca65-4dbe-8869-6766c4ddd956 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:22.879434 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-2931424b-ca65-4dbe-8869-6766c4ddd956 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:22.879434 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-2931424b-ca65-4dbe-8869-6766c4ddd956 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:23.003404 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-583bf1f8-1420-4179-a066-acfb91964c7f tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:23.004168 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-583bf1f8-1420-4179-a066-acfb91964c7f tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 3062e66d-4c2a-4212-b186-ecafec6bde2e] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:52:23.016234 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-583bf1f8-1420-4179-a066-acfb91964c7f tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:23.018715 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-583bf1f8-1420-4179-a066-acfb91964c7f tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:23.020580 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-583bf1f8-1420-4179-a066-acfb91964c7f tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:23.024604 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-583bf1f8-1420-4179-a066-acfb91964c7f tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:23.130333 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-2931424b-ca65-4dbe-8869-6766c4ddd956 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:23.141292 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-2931424b-ca65-4dbe-8869-6766c4ddd956 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:23.142832 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-2931424b-ca65-4dbe-8869-6766c4ddd956 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:23.143977 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-2931424b-ca65-4dbe-8869-6766c4ddd956 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9" status: 200 len: 1808 microversion: 2.20 time: 0.281411 May 12 14:52:23.145774 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 280/565] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:52:22 2022] GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9 => generated 1808 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:52:23.291037 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-526678b9-02d4-4442-8e5d-34e40fc6c72f tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:23.291889 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-526678b9-02d4-4442-8e5d-34e40fc6c72f tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 6f7de537-3c2b-4b45-a0da-e5b9ab7c169a] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:52:23.301556 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-526678b9-02d4-4442-8e5d-34e40fc6c72f tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:23.304887 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-526678b9-02d4-4442-8e5d-34e40fc6c72f tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:23.304887 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-526678b9-02d4-4442-8e5d-34e40fc6c72f tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:23.304887 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-526678b9-02d4-4442-8e5d-34e40fc6c72f tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:23.506423 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-583bf1f8-1420-4179-a066-acfb91964c7f tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e128ca83d6448c9ab1fe7dcc5467d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a090a68e336b4562aca524a95f550e04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:23.516329 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-583bf1f8-1420-4179-a066-acfb91964c7f tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e" status: 200 len: 1669 microversion: 2.1 time: 0.517181 May 12 14:52:23.526190 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 286/566] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:52:22 2022] GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e => generated 1669 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:52:23.554165 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-526678b9-02d4-4442-8e5d-34e40fc6c72f tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a641a08648b454780081ecc2e291066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a8451272cc41ebaf1598ed940bf09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:23.563957 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-526678b9-02d4-4442-8e5d-34e40fc6c72f tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/6f7de537-3c2b-4b45-a0da-e5b9ab7c169a" status: 200 len: 1367 microversion: 2.1 time: 0.280329 May 12 14:52:23.564730 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 281/567] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:52:23 2022] GET /compute/v2.1/servers/6f7de537-3c2b-4b45-a0da-e5b9ab7c169a => generated 1367 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:52:24.165147 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-489f0568-a77d-4da6-aef3-2b0b0b4a0e73 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:24.166094 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-489f0568-a77d-4da6-aef3-2b0b0b4a0e73 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:52:24.175790 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-489f0568-a77d-4da6-aef3-2b0b0b4a0e73 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:24.176609 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-489f0568-a77d-4da6-aef3-2b0b0b4a0e73 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:24.177458 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-489f0568-a77d-4da6-aef3-2b0b0b4a0e73 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:24.177898 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-489f0568-a77d-4da6-aef3-2b0b0b4a0e73 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:24.249930 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [req-0155fbad-834d-4e83-845b-777279e8524c req-810459be-151d-4ceb-ac7b-37f21ab4c622 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f7de537-3c2b-4b45-a0da-e5b9ab7c169a", "tag": "ad55ba66-712c-4c11-9515-ff16c19a8b63"}]} {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:52:24.253007 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:52:24.253007 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: warnings.warn(msg) May 12 14:52:24.265563 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [req-0155fbad-834d-4e83-845b-777279e8524c req-810459be-151d-4ceb-ac7b-37f21ab4c622 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:24.268227 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [req-0155fbad-834d-4e83-845b-777279e8524c req-810459be-151d-4ceb-ac7b-37f21ab4c622 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:24.285590 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.compute.server_external_events [req-0155fbad-834d-4e83-845b-777279e8524c req-810459be-151d-4ceb-ac7b-37f21ab4c622 service nova] Creating event network-changed:ad55ba66-712c-4c11-9515-ff16c19a8b63 for instance 6f7de537-3c2b-4b45-a0da-e5b9ab7c169a on hv-cinder-83118 May 12 14:52:24.291936 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [req-0155fbad-834d-4e83-845b-777279e8524c req-810459be-151d-4ceb-ac7b-37f21ab4c622 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048839 May 12 14:52:24.293090 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 282/568] 10.222.0.49 () {64 vars in 1317 bytes} [Thu May 12 14:52:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 14:52:24.420625 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-489f0568-a77d-4da6-aef3-2b0b0b4a0e73 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:24.432343 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-489f0568-a77d-4da6-aef3-2b0b0b4a0e73 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:24.433952 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-489f0568-a77d-4da6-aef3-2b0b0b4a0e73 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:24.435204 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-489f0568-a77d-4da6-aef3-2b0b0b4a0e73 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9" status: 200 len: 1808 microversion: 2.20 time: 0.274472 May 12 14:52:24.435859 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 287/569] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:52:24 2022] GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9 => generated 1808 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 14:52:24.582967 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-db6ead98-081f-45f2-adb3-9dabda78fb4e tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:24.583567 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-db6ead98-081f-45f2-adb3-9dabda78fb4e tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 6f7de537-3c2b-4b45-a0da-e5b9ab7c169a] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:52:24.591747 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-db6ead98-081f-45f2-adb3-9dabda78fb4e tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:24.592192 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-db6ead98-081f-45f2-adb3-9dabda78fb4e tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:24.592956 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-db6ead98-081f-45f2-adb3-9dabda78fb4e tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:24.593389 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-db6ead98-081f-45f2-adb3-9dabda78fb4e tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:24.807219 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-db6ead98-081f-45f2-adb3-9dabda78fb4e tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a641a08648b454780081ecc2e291066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a8451272cc41ebaf1598ed940bf09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:24.814294 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-db6ead98-081f-45f2-adb3-9dabda78fb4e tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/6f7de537-3c2b-4b45-a0da-e5b9ab7c169a" status: 200 len: 1367 microversion: 2.1 time: 0.235482 May 12 14:52:24.815025 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 283/570] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:52:24 2022] GET /compute/v2.1/servers/6f7de537-3c2b-4b45-a0da-e5b9ab7c169a => generated 1367 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:52:25.455388 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-49665f00-b793-4ff5-9b86-417c2239950d tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:25.455908 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-49665f00-b793-4ff5-9b86-417c2239950d tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:52:25.463824 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-49665f00-b793-4ff5-9b86-417c2239950d tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:25.465487 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-49665f00-b793-4ff5-9b86-417c2239950d tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:25.465487 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-49665f00-b793-4ff5-9b86-417c2239950d tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:25.465487 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-49665f00-b793-4ff5-9b86-417c2239950d tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:25.701121 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-49665f00-b793-4ff5-9b86-417c2239950d tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:25.710375 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-49665f00-b793-4ff5-9b86-417c2239950d tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:25.711846 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-49665f00-b793-4ff5-9b86-417c2239950d tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:25.712978 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-49665f00-b793-4ff5-9b86-417c2239950d tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9" status: 200 len: 1808 microversion: 2.20 time: 0.261497 May 12 14:52:25.713529 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 288/571] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:52:25 2022] GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9 => generated 1808 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:52:25.834957 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-55605861-63cd-4db8-83ae-f33391a8eb17 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:25.835580 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-55605861-63cd-4db8-83ae-f33391a8eb17 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 6f7de537-3c2b-4b45-a0da-e5b9ab7c169a] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:52:25.842805 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-55605861-63cd-4db8-83ae-f33391a8eb17 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:25.843278 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-55605861-63cd-4db8-83ae-f33391a8eb17 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:25.844045 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-55605861-63cd-4db8-83ae-f33391a8eb17 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:25.844477 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-55605861-63cd-4db8-83ae-f33391a8eb17 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:26.058522 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-55605861-63cd-4db8-83ae-f33391a8eb17 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a641a08648b454780081ecc2e291066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a8451272cc41ebaf1598ed940bf09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:26.071314 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-55605861-63cd-4db8-83ae-f33391a8eb17 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/6f7de537-3c2b-4b45-a0da-e5b9ab7c169a" status: 200 len: 1367 microversion: 2.1 time: 0.238626 May 12 14:52:26.071908 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 284/572] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:52:25 2022] GET /compute/v2.1/servers/6f7de537-3c2b-4b45-a0da-e5b9ab7c169a => generated 1367 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:52:26.732386 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-7a3c5194-249d-4d32-822d-f66035762e0b tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:26.732778 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-7a3c5194-249d-4d32-822d-f66035762e0b tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:52:26.741616 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-7a3c5194-249d-4d32-822d-f66035762e0b tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:26.742071 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-7a3c5194-249d-4d32-822d-f66035762e0b tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:26.742871 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-7a3c5194-249d-4d32-822d-f66035762e0b tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:26.743315 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-7a3c5194-249d-4d32-822d-f66035762e0b tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:27.091345 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-0b9ece92-d98b-4832-a84b-66133f213bb3 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:27.092569 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-0b9ece92-d98b-4832-a84b-66133f213bb3 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 6f7de537-3c2b-4b45-a0da-e5b9ab7c169a] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:52:27.100370 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-0b9ece92-d98b-4832-a84b-66133f213bb3 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:27.101032 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-0b9ece92-d98b-4832-a84b-66133f213bb3 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:27.101794 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-0b9ece92-d98b-4832-a84b-66133f213bb3 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:27.102279 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-0b9ece92-d98b-4832-a84b-66133f213bb3 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:27.109711 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-7a3c5194-249d-4d32-822d-f66035762e0b tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:27.119702 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-7a3c5194-249d-4d32-822d-f66035762e0b tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:27.121747 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-7a3c5194-249d-4d32-822d-f66035762e0b tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:27.123128 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-7a3c5194-249d-4d32-822d-f66035762e0b tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9" status: 200 len: 1808 microversion: 2.20 time: 0.395587 May 12 14:52:27.123677 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 289/573] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:52:26 2022] GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9 => generated 1808 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:52:27.322103 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-0b9ece92-d98b-4832-a84b-66133f213bb3 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a641a08648b454780081ecc2e291066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a8451272cc41ebaf1598ed940bf09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:27.330692 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-0b9ece92-d98b-4832-a84b-66133f213bb3 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/6f7de537-3c2b-4b45-a0da-e5b9ab7c169a" status: 200 len: 1367 microversion: 2.1 time: 0.243189 May 12 14:52:27.331376 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 285/574] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:52:27 2022] GET /compute/v2.1/servers/6f7de537-3c2b-4b45-a0da-e5b9ab7c169a => generated 1367 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:52:28.141123 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-a8e349b1-eff4-4977-97ef-cba0bec26c87 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:28.141728 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-a8e349b1-eff4-4977-97ef-cba0bec26c87 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:52:28.149920 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-a8e349b1-eff4-4977-97ef-cba0bec26c87 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:28.150411 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-a8e349b1-eff4-4977-97ef-cba0bec26c87 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:28.151159 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-a8e349b1-eff4-4977-97ef-cba0bec26c87 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:28.151594 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-a8e349b1-eff4-4977-97ef-cba0bec26c87 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:28.351566 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-c97e0e55-3965-40d1-9847-6c4d7813c30c tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:28.352178 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-c97e0e55-3965-40d1-9847-6c4d7813c30c tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 6f7de537-3c2b-4b45-a0da-e5b9ab7c169a] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:52:28.359979 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-c97e0e55-3965-40d1-9847-6c4d7813c30c tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:28.365208 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-c97e0e55-3965-40d1-9847-6c4d7813c30c tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:28.365208 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-c97e0e55-3965-40d1-9847-6c4d7813c30c tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:28.365208 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-c97e0e55-3965-40d1-9847-6c4d7813c30c tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:28.506920 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-a8e349b1-eff4-4977-97ef-cba0bec26c87 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:28.522802 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-a8e349b1-eff4-4977-97ef-cba0bec26c87 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:28.524343 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-a8e349b1-eff4-4977-97ef-cba0bec26c87 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:28.525966 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-a8e349b1-eff4-4977-97ef-cba0bec26c87 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9" status: 200 len: 1808 microversion: 2.20 time: 0.388360 May 12 14:52:28.526904 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 290/575] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:52:28 2022] GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9 => generated 1808 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:52:28.564660 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-c97e0e55-3965-40d1-9847-6c4d7813c30c tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a641a08648b454780081ecc2e291066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a8451272cc41ebaf1598ed940bf09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:28.574927 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-c97e0e55-3965-40d1-9847-6c4d7813c30c tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/6f7de537-3c2b-4b45-a0da-e5b9ab7c169a" status: 200 len: 1367 microversion: 2.1 time: 0.226915 May 12 14:52:28.575506 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 286/576] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:52:28 2022] GET /compute/v2.1/servers/6f7de537-3c2b-4b45-a0da-e5b9ab7c169a => generated 1367 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:52:29.545147 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-e192c0a8-c74b-42b9-826b-616d01d064c6 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:29.545789 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-e192c0a8-c74b-42b9-826b-616d01d064c6 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:52:29.553536 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e192c0a8-c74b-42b9-826b-616d01d064c6 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:29.553989 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e192c0a8-c74b-42b9-826b-616d01d064c6 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:29.554793 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e192c0a8-c74b-42b9-826b-616d01d064c6 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:29.555247 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e192c0a8-c74b-42b9-826b-616d01d064c6 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:29.592478 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-3967fe5d-82db-4a79-b013-fbf5373f1278 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:29.593256 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-3967fe5d-82db-4a79-b013-fbf5373f1278 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 6f7de537-3c2b-4b45-a0da-e5b9ab7c169a] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:52:29.600853 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-3967fe5d-82db-4a79-b013-fbf5373f1278 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:29.601584 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-3967fe5d-82db-4a79-b013-fbf5373f1278 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:29.602419 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-3967fe5d-82db-4a79-b013-fbf5373f1278 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:29.602947 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-3967fe5d-82db-4a79-b013-fbf5373f1278 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:29.776835 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-e192c0a8-c74b-42b9-826b-616d01d064c6 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:29.787668 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-e192c0a8-c74b-42b9-826b-616d01d064c6 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:29.789180 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-e192c0a8-c74b-42b9-826b-616d01d064c6 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:29.790583 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-e192c0a8-c74b-42b9-826b-616d01d064c6 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9" status: 200 len: 1808 microversion: 2.20 time: 0.249231 May 12 14:52:29.791172 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 291/577] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:52:29 2022] GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9 => generated 1808 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:52:29.804045 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-3967fe5d-82db-4a79-b013-fbf5373f1278 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a641a08648b454780081ecc2e291066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a8451272cc41ebaf1598ed940bf09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:29.812641 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-3967fe5d-82db-4a79-b013-fbf5373f1278 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/6f7de537-3c2b-4b45-a0da-e5b9ab7c169a" status: 200 len: 1367 microversion: 2.1 time: 0.225006 May 12 14:52:29.816490 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 287/578] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:52:29 2022] GET /compute/v2.1/servers/6f7de537-3c2b-4b45-a0da-e5b9ab7c169a => generated 1367 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:52:30.808555 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-ec04d68e-eac3-4a79-be22-d1358b1e60e8 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:30.809146 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-ec04d68e-eac3-4a79-be22-d1358b1e60e8 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:52:30.816155 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-ec04d68e-eac3-4a79-be22-d1358b1e60e8 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:30.816622 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-ec04d68e-eac3-4a79-be22-d1358b1e60e8 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:30.817377 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-ec04d68e-eac3-4a79-be22-d1358b1e60e8 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:30.817800 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-ec04d68e-eac3-4a79-be22-d1358b1e60e8 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:30.831780 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-7983ac42-4b1e-4122-a4f2-057665bb0b22 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:30.832395 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-7983ac42-4b1e-4122-a4f2-057665bb0b22 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 6f7de537-3c2b-4b45-a0da-e5b9ab7c169a] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:52:30.839605 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-7983ac42-4b1e-4122-a4f2-057665bb0b22 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:30.841710 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-7983ac42-4b1e-4122-a4f2-057665bb0b22 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:30.841710 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-7983ac42-4b1e-4122-a4f2-057665bb0b22 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:30.841710 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-7983ac42-4b1e-4122-a4f2-057665bb0b22 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:31.032685 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-ec04d68e-eac3-4a79-be22-d1358b1e60e8 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:31.042701 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-ec04d68e-eac3-4a79-be22-d1358b1e60e8 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:31.044550 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-ec04d68e-eac3-4a79-be22-d1358b1e60e8 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:31.046001 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-ec04d68e-eac3-4a79-be22-d1358b1e60e8 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9" status: 200 len: 1808 microversion: 2.20 time: 0.241139 May 12 14:52:31.046726 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 292/579] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:52:30 2022] GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9 => generated 1808 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 14:52:31.151885 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-7983ac42-4b1e-4122-a4f2-057665bb0b22 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a641a08648b454780081ecc2e291066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a8451272cc41ebaf1598ed940bf09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:31.163790 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-7983ac42-4b1e-4122-a4f2-057665bb0b22 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/6f7de537-3c2b-4b45-a0da-e5b9ab7c169a" status: 200 len: 1367 microversion: 2.1 time: 0.335672 May 12 14:52:31.175511 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 288/580] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:52:30 2022] GET /compute/v2.1/servers/6f7de537-3c2b-4b45-a0da-e5b9ab7c169a => generated 1367 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:52:32.064829 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-f8689b0b-df80-494a-853e-b583f50efece tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:32.065443 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-f8689b0b-df80-494a-853e-b583f50efece tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:52:32.072781 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-f8689b0b-df80-494a-853e-b583f50efece tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:32.073232 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-f8689b0b-df80-494a-853e-b583f50efece tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:32.074004 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-f8689b0b-df80-494a-853e-b583f50efece tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:32.074441 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-f8689b0b-df80-494a-853e-b583f50efece tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:32.192397 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-2ad20dd3-3a90-40d7-b25b-cc9d2e70f287 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:32.193053 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-2ad20dd3-3a90-40d7-b25b-cc9d2e70f287 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 6f7de537-3c2b-4b45-a0da-e5b9ab7c169a] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:52:32.207634 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-2ad20dd3-3a90-40d7-b25b-cc9d2e70f287 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:32.211328 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-2ad20dd3-3a90-40d7-b25b-cc9d2e70f287 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:32.212141 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-2ad20dd3-3a90-40d7-b25b-cc9d2e70f287 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:32.212587 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-2ad20dd3-3a90-40d7-b25b-cc9d2e70f287 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:32.344539 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-f8689b0b-df80-494a-853e-b583f50efece tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:32.354032 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-f8689b0b-df80-494a-853e-b583f50efece tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:32.355627 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-f8689b0b-df80-494a-853e-b583f50efece tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:32.356767 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-f8689b0b-df80-494a-853e-b583f50efece tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9" status: 200 len: 1808 microversion: 2.20 time: 0.295743 May 12 14:52:32.357323 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 293/581] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:52:32 2022] GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9 => generated 1808 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:52:32.361751 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [req-3e992083-72cb-482b-98dc-c19c24c85251 req-903e7c55-6b69-402c-96f2-eb10b9aa0f7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f7de537-3c2b-4b45-a0da-e5b9ab7c169a", "name": "network-vif-plugged", "status": "completed", "tag": "ad55ba66-712c-4c11-9515-ff16c19a8b63"}]} {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:52:32.363560 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:52:32.363560 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: warnings.warn(msg) May 12 14:52:32.372471 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [req-3e992083-72cb-482b-98dc-c19c24c85251 req-903e7c55-6b69-402c-96f2-eb10b9aa0f7f service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:32.372921 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [req-3e992083-72cb-482b-98dc-c19c24c85251 req-903e7c55-6b69-402c-96f2-eb10b9aa0f7f service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:32.390654 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.compute.server_external_events [req-3e992083-72cb-482b-98dc-c19c24c85251 req-903e7c55-6b69-402c-96f2-eb10b9aa0f7f service nova] Creating event network-vif-plugged:ad55ba66-712c-4c11-9515-ff16c19a8b63 for instance 6f7de537-3c2b-4b45-a0da-e5b9ab7c169a on hv-cinder-83118 May 12 14:52:32.395654 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [req-3e992083-72cb-482b-98dc-c19c24c85251 req-903e7c55-6b69-402c-96f2-eb10b9aa0f7f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037205 May 12 14:52:32.396432 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 294/582] 10.222.0.49 () {64 vars in 1317 bytes} [Thu May 12 14:52:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:52:32.443594 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-2ad20dd3-3a90-40d7-b25b-cc9d2e70f287 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a641a08648b454780081ecc2e291066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a8451272cc41ebaf1598ed940bf09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:32.454888 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-2ad20dd3-3a90-40d7-b25b-cc9d2e70f287 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/6f7de537-3c2b-4b45-a0da-e5b9ab7c169a" status: 200 len: 1367 microversion: 2.1 time: 0.265954 May 12 14:52:32.455721 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 289/583] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:52:32 2022] GET /compute/v2.1/servers/6f7de537-3c2b-4b45-a0da-e5b9ab7c169a => generated 1367 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:52:33.376217 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-6e654e11-4801-45b7-a693-022fb03b4d2e tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:33.377362 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-6e654e11-4801-45b7-a693-022fb03b4d2e tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:52:33.385262 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-6e654e11-4801-45b7-a693-022fb03b4d2e tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:33.385960 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-6e654e11-4801-45b7-a693-022fb03b4d2e tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:33.397221 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-6e654e11-4801-45b7-a693-022fb03b4d2e tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:33.397221 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-6e654e11-4801-45b7-a693-022fb03b4d2e tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:33.471667 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-eb78d34c-971e-45fe-9980-f6753bfa8913 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:33.472283 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-eb78d34c-971e-45fe-9980-f6753bfa8913 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 6f7de537-3c2b-4b45-a0da-e5b9ab7c169a] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:52:33.479824 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-eb78d34c-971e-45fe-9980-f6753bfa8913 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:33.480276 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-eb78d34c-971e-45fe-9980-f6753bfa8913 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:33.481051 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-eb78d34c-971e-45fe-9980-f6753bfa8913 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:33.481672 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-eb78d34c-971e-45fe-9980-f6753bfa8913 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:33.620956 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-6e654e11-4801-45b7-a693-022fb03b4d2e tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:33.631477 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-6e654e11-4801-45b7-a693-022fb03b4d2e tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:33.632772 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-6e654e11-4801-45b7-a693-022fb03b4d2e tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:33.634090 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-6e654e11-4801-45b7-a693-022fb03b4d2e tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9" status: 200 len: 1808 microversion: 2.20 time: 0.261986 May 12 14:52:33.644869 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 295/584] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:52:33 2022] GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9 => generated 1808 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:52:33.698752 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-eb78d34c-971e-45fe-9980-f6753bfa8913 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a641a08648b454780081ecc2e291066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a8451272cc41ebaf1598ed940bf09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:33.707249 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-eb78d34c-971e-45fe-9980-f6753bfa8913 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/6f7de537-3c2b-4b45-a0da-e5b9ab7c169a" status: 200 len: 1367 microversion: 2.1 time: 0.239367 May 12 14:52:33.708099 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 290/585] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:52:33 2022] GET /compute/v2.1/servers/6f7de537-3c2b-4b45-a0da-e5b9ab7c169a => generated 1367 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:52:33.766787 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-58cca089-8641-41a3-a887-c83759b0591a tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:52:33.767924 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-58cca089-8641-41a3-a887-c83759b0591a tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 944e4e2e-d09f-4dd7-ac42-b037b09dc7c3] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:52:33.776455 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-58cca089-8641-41a3-a887-c83759b0591a tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:33.776999 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-58cca089-8641-41a3-a887-c83759b0591a tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:33.777779 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-58cca089-8641-41a3-a887-c83759b0591a tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:33.778393 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-58cca089-8641-41a3-a887-c83759b0591a tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:33.840129 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.objects.instance [None req-58cca089-8641-41a3-a887-c83759b0591a tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lazy-loading 'flavor' on Instance uuid 944e4e2e-d09f-4dd7-ac42-b037b09dc7c3 {{(pid=102213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 12 14:52:34.469203 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-58cca089-8641-41a3-a887-c83759b0591a tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "POST /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3/action" status: 200 len: 32 microversion: 2.1 time: 0.706276 May 12 14:52:34.477760 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 296/586] 10.222.0.49 () {60 vars in 1277 bytes} [Thu May 12 14:52:33 2022] POST /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3/action => generated 32 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 12 14:52:34.485311 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-3b4453e2-96fd-4e66-a3f9-83e9ba1081d1 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:34.485963 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-3b4453e2-96fd-4e66-a3f9-83e9ba1081d1 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 944e4e2e-d09f-4dd7-ac42-b037b09dc7c3] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:52:34.493769 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-3b4453e2-96fd-4e66-a3f9-83e9ba1081d1 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:34.494211 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-3b4453e2-96fd-4e66-a3f9-83e9ba1081d1 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:34.495106 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-3b4453e2-96fd-4e66-a3f9-83e9ba1081d1 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:34.495541 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-3b4453e2-96fd-4e66-a3f9-83e9ba1081d1 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:34.652963 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-1bc56c1f-a746-4766-a91c-94f0c66d76b5 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:34.655893 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-1bc56c1f-a746-4766-a91c-94f0c66d76b5 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:52:34.664377 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-1bc56c1f-a746-4766-a91c-94f0c66d76b5 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:34.664999 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-1bc56c1f-a746-4766-a91c-94f0c66d76b5 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:34.666010 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-1bc56c1f-a746-4766-a91c-94f0c66d76b5 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:34.666459 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-1bc56c1f-a746-4766-a91c-94f0c66d76b5 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:34.730763 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-3b4453e2-96fd-4e66-a3f9-83e9ba1081d1 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:34.743288 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-3b4453e2-96fd-4e66-a3f9-83e9ba1081d1 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3" status: 200 len: 1733 microversion: 2.1 time: 0.261553 May 12 14:52:34.753306 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 291/587] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:52:34 2022] GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3 => generated 1733 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:52:34.756277 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-852071da-07cc-4af9-8de6-117cc5bcff93 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:34.759116 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-852071da-07cc-4af9-8de6-117cc5bcff93 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 6f7de537-3c2b-4b45-a0da-e5b9ab7c169a] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:52:34.768102 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-852071da-07cc-4af9-8de6-117cc5bcff93 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:34.768550 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-852071da-07cc-4af9-8de6-117cc5bcff93 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:34.769322 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-852071da-07cc-4af9-8de6-117cc5bcff93 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:34.769752 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-852071da-07cc-4af9-8de6-117cc5bcff93 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:34.976535 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-852071da-07cc-4af9-8de6-117cc5bcff93 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a641a08648b454780081ecc2e291066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a8451272cc41ebaf1598ed940bf09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:34.984823 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-852071da-07cc-4af9-8de6-117cc5bcff93 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/6f7de537-3c2b-4b45-a0da-e5b9ab7c169a" status: 200 len: 1557 microversion: 2.1 time: 0.233056 May 12 14:52:34.985401 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 292/588] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:52:34 2022] GET /compute/v2.1/servers/6f7de537-3c2b-4b45-a0da-e5b9ab7c169a => generated 1557 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:52:34.999301 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-1bc56c1f-a746-4766-a91c-94f0c66d76b5 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:35.002032 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-0df11609-04f6-4174-9a66-7f846ef1e675 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:35.002530 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-0df11609-04f6-4174-9a66-7f846ef1e675 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 6f7de537-3c2b-4b45-a0da-e5b9ab7c169a] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:52:35.009636 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-1bc56c1f-a746-4766-a91c-94f0c66d76b5 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:35.010239 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-0df11609-04f6-4174-9a66-7f846ef1e675 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:35.010699 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-0df11609-04f6-4174-9a66-7f846ef1e675 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:35.011510 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-0df11609-04f6-4174-9a66-7f846ef1e675 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:35.011626 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-1bc56c1f-a746-4766-a91c-94f0c66d76b5 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:35.011946 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-0df11609-04f6-4174-9a66-7f846ef1e675 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:35.012956 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-1bc56c1f-a746-4766-a91c-94f0c66d76b5 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9" status: 200 len: 1808 microversion: 2.20 time: 0.364776 May 12 14:52:35.013676 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 297/589] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:52:34 2022] GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9 => generated 1808 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:52:35.174105 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-0df11609-04f6-4174-9a66-7f846ef1e675 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/6f7de537-3c2b-4b45-a0da-e5b9ab7c169a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.175674 May 12 14:52:35.175233 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 293/590] 10.222.0.49 () {58 vars in 1274 bytes} [Thu May 12 14:52:34 2022] GET /compute/v2.1/servers/6f7de537-3c2b-4b45-a0da-e5b9ab7c169a/os-interface => generated 284 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 14:52:35.765398 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-f3196148-1443-44b4-8168-e6638409d423 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:35.765398 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-f3196148-1443-44b4-8168-e6638409d423 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 944e4e2e-d09f-4dd7-ac42-b037b09dc7c3] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:52:35.768775 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-f3196148-1443-44b4-8168-e6638409d423 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:35.769232 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-f3196148-1443-44b4-8168-e6638409d423 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:35.770009 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-f3196148-1443-44b4-8168-e6638409d423 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:35.770443 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-f3196148-1443-44b4-8168-e6638409d423 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:35.974706 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-f3196148-1443-44b4-8168-e6638409d423 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:35.983266 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-f3196148-1443-44b4-8168-e6638409d423 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3" status: 200 len: 1733 microversion: 2.1 time: 0.226329 May 12 14:52:35.983836 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 298/591] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:52:35 2022] GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3 => generated 1733 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:52:36.031905 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-f9a6eb00-5df9-43b9-9024-85936d0cafab tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:36.032775 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-f9a6eb00-5df9-43b9-9024-85936d0cafab tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:52:36.041603 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-f9a6eb00-5df9-43b9-9024-85936d0cafab tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:36.041603 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-f9a6eb00-5df9-43b9-9024-85936d0cafab tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:36.041990 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-f9a6eb00-5df9-43b9-9024-85936d0cafab tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:36.042426 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-f9a6eb00-5df9-43b9-9024-85936d0cafab tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:36.581227 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-f9a6eb00-5df9-43b9-9024-85936d0cafab tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:36.590943 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-f9a6eb00-5df9-43b9-9024-85936d0cafab tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:36.592455 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-f9a6eb00-5df9-43b9-9024-85936d0cafab tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:36.593585 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-f9a6eb00-5df9-43b9-9024-85936d0cafab tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9" status: 200 len: 1808 microversion: 2.20 time: 0.565528 May 12 14:52:36.594147 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 294/592] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:52:36 2022] GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9 => generated 1808 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:52:37.001191 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-2a097846-e000-40b0-ba57-ee42e446dcb8 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:37.001800 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-2a097846-e000-40b0-ba57-ee42e446dcb8 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 944e4e2e-d09f-4dd7-ac42-b037b09dc7c3] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:52:37.010843 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-2a097846-e000-40b0-ba57-ee42e446dcb8 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:37.011375 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-2a097846-e000-40b0-ba57-ee42e446dcb8 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:37.012229 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-2a097846-e000-40b0-ba57-ee42e446dcb8 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:37.012733 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-2a097846-e000-40b0-ba57-ee42e446dcb8 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:37.014267 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [req-e741ede2-4278-44fa-9c48-e8911009f6e6 req-973a4876-2fda-4d07-82f0-62d5d23d6691 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f7de537-3c2b-4b45-a0da-e5b9ab7c169a", "tag": "ad55ba66-712c-4c11-9515-ff16c19a8b63"}]} {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:52:37.015835 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:52:37.015835 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: warnings.warn(msg) May 12 14:52:37.024353 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [req-e741ede2-4278-44fa-9c48-e8911009f6e6 req-973a4876-2fda-4d07-82f0-62d5d23d6691 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:37.024804 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [req-e741ede2-4278-44fa-9c48-e8911009f6e6 req-973a4876-2fda-4d07-82f0-62d5d23d6691 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:37.040794 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.compute.server_external_events [req-e741ede2-4278-44fa-9c48-e8911009f6e6 req-973a4876-2fda-4d07-82f0-62d5d23d6691 service nova] Creating event network-changed:ad55ba66-712c-4c11-9515-ff16c19a8b63 for instance 6f7de537-3c2b-4b45-a0da-e5b9ab7c169a on hv-cinder-83118 May 12 14:52:37.045635 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [req-e741ede2-4278-44fa-9c48-e8911009f6e6 req-973a4876-2fda-4d07-82f0-62d5d23d6691 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034903 May 12 14:52:37.046219 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 295/593] 10.222.0.49 () {64 vars in 1317 bytes} [Thu May 12 14:52:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 14:52:37.222730 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-2a097846-e000-40b0-ba57-ee42e446dcb8 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:37.232966 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-2a097846-e000-40b0-ba57-ee42e446dcb8 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3" status: 200 len: 1733 microversion: 2.1 time: 0.235416 May 12 14:52:37.233653 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 299/594] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:52:36 2022] GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3 => generated 1733 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:52:37.612731 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-32b1f2a6-6bf4-4f23-b9e1-2bb17bfa364b tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:37.613649 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-32b1f2a6-6bf4-4f23-b9e1-2bb17bfa364b tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:52:37.621437 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-32b1f2a6-6bf4-4f23-b9e1-2bb17bfa364b tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:37.621967 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-32b1f2a6-6bf4-4f23-b9e1-2bb17bfa364b tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:37.622844 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-32b1f2a6-6bf4-4f23-b9e1-2bb17bfa364b tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:37.623451 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-32b1f2a6-6bf4-4f23-b9e1-2bb17bfa364b tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:37.743567 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [req-e4961f68-2cab-4a7f-96a0-41ca38a6710b req-445b62ec-050f-4596-b379-0ca5ae38e465 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9", "name": "network-vif-plugged", "status": "completed", "tag": "892fd785-17e4-4442-9f7d-2e5d18b22e9f"}]} {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:52:37.746598 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:52:37.746598 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: warnings.warn(msg) May 12 14:52:37.755773 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [req-e4961f68-2cab-4a7f-96a0-41ca38a6710b req-445b62ec-050f-4596-b379-0ca5ae38e465 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:37.756339 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [req-e4961f68-2cab-4a7f-96a0-41ca38a6710b req-445b62ec-050f-4596-b379-0ca5ae38e465 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:37.772936 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.compute.server_external_events [req-e4961f68-2cab-4a7f-96a0-41ca38a6710b req-445b62ec-050f-4596-b379-0ca5ae38e465 service nova] Creating event network-vif-plugged:892fd785-17e4-4442-9f7d-2e5d18b22e9f for instance a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9 on hv-cinder-83118 May 12 14:52:37.777767 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [req-e4961f68-2cab-4a7f-96a0-41ca38a6710b req-445b62ec-050f-4596-b379-0ca5ae38e465 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038725 May 12 14:52:37.778577 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 300/595] 10.222.0.49 () {64 vars in 1317 bytes} [Thu May 12 14:52:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:52:37.831804 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-32b1f2a6-6bf4-4f23-b9e1-2bb17bfa364b tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:37.843307 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-32b1f2a6-6bf4-4f23-b9e1-2bb17bfa364b tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:37.844861 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-32b1f2a6-6bf4-4f23-b9e1-2bb17bfa364b tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:37.846116 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-32b1f2a6-6bf4-4f23-b9e1-2bb17bfa364b tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9" status: 200 len: 1808 microversion: 2.20 time: 0.237735 May 12 14:52:37.846679 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 296/596] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:52:37 2022] GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9 => generated 1808 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:52:38.251517 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-6f415184-dbc4-45bc-a625-fa1dac9b84eb tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:38.252402 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-6f415184-dbc4-45bc-a625-fa1dac9b84eb tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 944e4e2e-d09f-4dd7-ac42-b037b09dc7c3] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:52:38.260771 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-6f415184-dbc4-45bc-a625-fa1dac9b84eb tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:38.261475 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-6f415184-dbc4-45bc-a625-fa1dac9b84eb tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:38.262348 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-6f415184-dbc4-45bc-a625-fa1dac9b84eb tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:38.262943 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-6f415184-dbc4-45bc-a625-fa1dac9b84eb tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:38.465739 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-6f415184-dbc4-45bc-a625-fa1dac9b84eb tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:38.474389 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-6f415184-dbc4-45bc-a625-fa1dac9b84eb tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3" status: 200 len: 1733 microversion: 2.1 time: 0.227241 May 12 14:52:38.474985 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 301/597] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:52:38 2022] GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3 => generated 1733 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:52:38.865462 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-838a9a00-0577-45d7-a436-f0c6d452b0a3 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:38.866123 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-838a9a00-0577-45d7-a436-f0c6d452b0a3 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:52:38.873575 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-838a9a00-0577-45d7-a436-f0c6d452b0a3 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:38.874020 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-838a9a00-0577-45d7-a436-f0c6d452b0a3 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:38.874840 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-838a9a00-0577-45d7-a436-f0c6d452b0a3 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:38.875283 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-838a9a00-0577-45d7-a436-f0c6d452b0a3 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:39.074137 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-838a9a00-0577-45d7-a436-f0c6d452b0a3 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:39.084110 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-838a9a00-0577-45d7-a436-f0c6d452b0a3 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:39.085647 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-838a9a00-0577-45d7-a436-f0c6d452b0a3 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:39.086772 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-838a9a00-0577-45d7-a436-f0c6d452b0a3 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9" status: 200 len: 1808 microversion: 2.20 time: 0.225707 May 12 14:52:39.097769 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 297/598] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:52:38 2022] GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9 => generated 1808 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:52:39.492075 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-6d598d9c-a033-455a-99a7-3e0430084594 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:39.492764 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-6d598d9c-a033-455a-99a7-3e0430084594 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 944e4e2e-d09f-4dd7-ac42-b037b09dc7c3] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:52:39.500121 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-6d598d9c-a033-455a-99a7-3e0430084594 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:39.500571 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-6d598d9c-a033-455a-99a7-3e0430084594 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:39.501339 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-6d598d9c-a033-455a-99a7-3e0430084594 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:39.501773 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-6d598d9c-a033-455a-99a7-3e0430084594 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:39.697632 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-6d598d9c-a033-455a-99a7-3e0430084594 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:39.706148 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-6d598d9c-a033-455a-99a7-3e0430084594 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3" status: 200 len: 1733 microversion: 2.1 time: 0.218425 May 12 14:52:39.706704 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 302/599] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:52:39 2022] GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3 => generated 1733 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:52:40.105344 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-1392afa0-fb65-4434-b6d3-f4dd6c8f3cb1 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:40.105896 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-1392afa0-fb65-4434-b6d3-f4dd6c8f3cb1 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:52:40.113157 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-1392afa0-fb65-4434-b6d3-f4dd6c8f3cb1 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:40.113607 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-1392afa0-fb65-4434-b6d3-f4dd6c8f3cb1 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:40.114379 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-1392afa0-fb65-4434-b6d3-f4dd6c8f3cb1 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:40.115359 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-1392afa0-fb65-4434-b6d3-f4dd6c8f3cb1 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:40.324269 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-1392afa0-fb65-4434-b6d3-f4dd6c8f3cb1 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:40.334088 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-1392afa0-fb65-4434-b6d3-f4dd6c8f3cb1 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:40.335654 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-1392afa0-fb65-4434-b6d3-f4dd6c8f3cb1 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:40.336881 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-1392afa0-fb65-4434-b6d3-f4dd6c8f3cb1 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9" status: 200 len: 1808 microversion: 2.20 time: 0.235404 May 12 14:52:40.337420 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 298/600] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:52:40 2022] GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9 => generated 1808 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:52:40.724111 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-d1963e6b-81c4-47a7-a56a-21b9e1f98d08 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:40.725495 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-d1963e6b-81c4-47a7-a56a-21b9e1f98d08 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 944e4e2e-d09f-4dd7-ac42-b037b09dc7c3] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:52:40.732799 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-d1963e6b-81c4-47a7-a56a-21b9e1f98d08 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:40.733251 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-d1963e6b-81c4-47a7-a56a-21b9e1f98d08 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:40.734021 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-d1963e6b-81c4-47a7-a56a-21b9e1f98d08 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:40.734460 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-d1963e6b-81c4-47a7-a56a-21b9e1f98d08 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:40.940868 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-d1963e6b-81c4-47a7-a56a-21b9e1f98d08 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:40.950336 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-d1963e6b-81c4-47a7-a56a-21b9e1f98d08 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3" status: 200 len: 1733 microversion: 2.1 time: 0.229983 May 12 14:52:40.950951 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 303/601] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:52:40 2022] GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3 => generated 1733 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:52:41.360387 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-caa194f3-5b91-4616-9e61-2424ecb8e265 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:41.361089 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-caa194f3-5b91-4616-9e61-2424ecb8e265 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:52:41.369369 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-caa194f3-5b91-4616-9e61-2424ecb8e265 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:41.369828 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-caa194f3-5b91-4616-9e61-2424ecb8e265 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:41.370649 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-caa194f3-5b91-4616-9e61-2424ecb8e265 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:41.371129 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-caa194f3-5b91-4616-9e61-2424ecb8e265 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:41.581365 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-caa194f3-5b91-4616-9e61-2424ecb8e265 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:41.591423 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-caa194f3-5b91-4616-9e61-2424ecb8e265 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:41.592940 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-caa194f3-5b91-4616-9e61-2424ecb8e265 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:41.594074 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-caa194f3-5b91-4616-9e61-2424ecb8e265 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9" status: 200 len: 1808 microversion: 2.20 time: 0.242877 May 12 14:52:41.594629 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 299/602] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:52:41 2022] GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9 => generated 1808 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:52:41.968253 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-93c88e51-eb42-4186-83f1-6918ffbb5f56 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:41.968866 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-93c88e51-eb42-4186-83f1-6918ffbb5f56 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 944e4e2e-d09f-4dd7-ac42-b037b09dc7c3] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:52:41.976786 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-93c88e51-eb42-4186-83f1-6918ffbb5f56 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:41.977231 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-93c88e51-eb42-4186-83f1-6918ffbb5f56 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:41.977995 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-93c88e51-eb42-4186-83f1-6918ffbb5f56 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:41.978427 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-93c88e51-eb42-4186-83f1-6918ffbb5f56 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:42.241868 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-93c88e51-eb42-4186-83f1-6918ffbb5f56 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:42.250646 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-93c88e51-eb42-4186-83f1-6918ffbb5f56 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3" status: 200 len: 1733 microversion: 2.1 time: 0.285979 May 12 14:52:42.251424 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 304/603] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:52:41 2022] GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3 => generated 1733 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:52:42.612253 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-b8de3315-5f0f-4f9c-9a5c-65f321cc0750 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:42.613218 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-b8de3315-5f0f-4f9c-9a5c-65f321cc0750 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:52:42.620630 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-b8de3315-5f0f-4f9c-9a5c-65f321cc0750 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:42.629223 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-b8de3315-5f0f-4f9c-9a5c-65f321cc0750 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:42.629223 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-b8de3315-5f0f-4f9c-9a5c-65f321cc0750 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:42.629223 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-b8de3315-5f0f-4f9c-9a5c-65f321cc0750 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:42.818857 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-b8de3315-5f0f-4f9c-9a5c-65f321cc0750 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:42.828077 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-b8de3315-5f0f-4f9c-9a5c-65f321cc0750 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:42.829595 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-b8de3315-5f0f-4f9c-9a5c-65f321cc0750 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:42.830913 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-b8de3315-5f0f-4f9c-9a5c-65f321cc0750 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9" status: 200 len: 1808 microversion: 2.20 time: 0.222263 May 12 14:52:42.831364 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 300/604] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:52:42 2022] GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9 => generated 1808 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:52:43.267242 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-bcf8783e-775e-4270-976b-b75de80f6412 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:43.267855 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-bcf8783e-775e-4270-976b-b75de80f6412 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 944e4e2e-d09f-4dd7-ac42-b037b09dc7c3] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:52:43.275119 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-bcf8783e-775e-4270-976b-b75de80f6412 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:43.275610 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-bcf8783e-775e-4270-976b-b75de80f6412 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:43.276321 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-bcf8783e-775e-4270-976b-b75de80f6412 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:43.276750 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-bcf8783e-775e-4270-976b-b75de80f6412 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:43.482322 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-bcf8783e-775e-4270-976b-b75de80f6412 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:43.493963 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-bcf8783e-775e-4270-976b-b75de80f6412 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3" status: 200 len: 1733 microversion: 2.1 time: 0.229928 May 12 14:52:43.494688 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 305/605] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:52:43 2022] GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3 => generated 1733 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:52:43.848951 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-e7b2d13d-d23c-42c8-8837-00ce709a1d82 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:43.850110 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-e7b2d13d-d23c-42c8-8837-00ce709a1d82 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:52:43.857588 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-e7b2d13d-d23c-42c8-8837-00ce709a1d82 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:43.858044 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-e7b2d13d-d23c-42c8-8837-00ce709a1d82 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:43.858848 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-e7b2d13d-d23c-42c8-8837-00ce709a1d82 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:43.859295 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-e7b2d13d-d23c-42c8-8837-00ce709a1d82 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:44.070364 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-e7b2d13d-d23c-42c8-8837-00ce709a1d82 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:44.079460 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-e7b2d13d-d23c-42c8-8837-00ce709a1d82 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:44.080949 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-e7b2d13d-d23c-42c8-8837-00ce709a1d82 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:44.082060 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-e7b2d13d-d23c-42c8-8837-00ce709a1d82 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9" status: 200 len: 1795 microversion: 2.20 time: 0.237336 May 12 14:52:44.082617 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 301/606] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:52:43 2022] GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9 => generated 1795 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:52:44.511977 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-6526c52e-49cb-4c6d-b6ed-588420a5beef tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:44.512631 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-6526c52e-49cb-4c6d-b6ed-588420a5beef tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 944e4e2e-d09f-4dd7-ac42-b037b09dc7c3] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:52:44.519816 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-6526c52e-49cb-4c6d-b6ed-588420a5beef tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:44.520264 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-6526c52e-49cb-4c6d-b6ed-588420a5beef tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:44.521018 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-6526c52e-49cb-4c6d-b6ed-588420a5beef tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:44.521450 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-6526c52e-49cb-4c6d-b6ed-588420a5beef tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:44.714657 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-6526c52e-49cb-4c6d-b6ed-588420a5beef tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:44.723123 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-6526c52e-49cb-4c6d-b6ed-588420a5beef tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3" status: 200 len: 1733 microversion: 2.1 time: 0.214828 May 12 14:52:44.723717 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 306/607] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:52:44 2022] GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3 => generated 1733 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:52:45.740598 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-2e281bf7-23be-4687-9eee-0e90e18c4419 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:45.741148 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-2e281bf7-23be-4687-9eee-0e90e18c4419 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 944e4e2e-d09f-4dd7-ac42-b037b09dc7c3] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:52:45.748460 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-2e281bf7-23be-4687-9eee-0e90e18c4419 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:45.748909 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-2e281bf7-23be-4687-9eee-0e90e18c4419 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:45.749868 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-2e281bf7-23be-4687-9eee-0e90e18c4419 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:45.750328 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-2e281bf7-23be-4687-9eee-0e90e18c4419 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:45.944610 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-2e281bf7-23be-4687-9eee-0e90e18c4419 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:45.953451 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-2e281bf7-23be-4687-9eee-0e90e18c4419 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3" status: 200 len: 1733 microversion: 2.1 time: 0.216658 May 12 14:52:45.956824 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 302/608] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:52:45 2022] GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3 => generated 1733 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:52:46.972465 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-71655d40-310d-4a98-a31f-2e75db94dbdd tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:46.973066 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-71655d40-310d-4a98-a31f-2e75db94dbdd tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 944e4e2e-d09f-4dd7-ac42-b037b09dc7c3] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:52:46.980367 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-71655d40-310d-4a98-a31f-2e75db94dbdd tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:46.980812 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-71655d40-310d-4a98-a31f-2e75db94dbdd tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:46.981571 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-71655d40-310d-4a98-a31f-2e75db94dbdd tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:46.982001 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-71655d40-310d-4a98-a31f-2e75db94dbdd tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:47.179962 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-71655d40-310d-4a98-a31f-2e75db94dbdd tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:47.188721 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-71655d40-310d-4a98-a31f-2e75db94dbdd tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3" status: 200 len: 1733 microversion: 2.1 time: 0.219916 May 12 14:52:47.189284 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 307/609] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:52:46 2022] GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3 => generated 1733 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:52:48.206239 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-a60fd7f0-e3da-4eeb-85d0-f3e53a836eac tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:48.206924 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-a60fd7f0-e3da-4eeb-85d0-f3e53a836eac tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 944e4e2e-d09f-4dd7-ac42-b037b09dc7c3] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:52:48.214661 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-a60fd7f0-e3da-4eeb-85d0-f3e53a836eac tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:48.215147 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-a60fd7f0-e3da-4eeb-85d0-f3e53a836eac tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:48.215911 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-a60fd7f0-e3da-4eeb-85d0-f3e53a836eac tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:48.216343 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-a60fd7f0-e3da-4eeb-85d0-f3e53a836eac tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:48.415496 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-a60fd7f0-e3da-4eeb-85d0-f3e53a836eac tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:48.424097 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-a60fd7f0-e3da-4eeb-85d0-f3e53a836eac tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3" status: 200 len: 1733 microversion: 2.1 time: 0.221604 May 12 14:52:48.424662 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 303/610] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:52:48 2022] GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3 => generated 1733 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:52:49.441238 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-b05aadc4-d5b8-4e98-862a-adc41457da65 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:49.441849 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-b05aadc4-d5b8-4e98-862a-adc41457da65 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 944e4e2e-d09f-4dd7-ac42-b037b09dc7c3] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:52:49.459193 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-b05aadc4-d5b8-4e98-862a-adc41457da65 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:49.459193 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-b05aadc4-d5b8-4e98-862a-adc41457da65 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:49.459193 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-b05aadc4-d5b8-4e98-862a-adc41457da65 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:49.459193 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-b05aadc4-d5b8-4e98-862a-adc41457da65 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:49.660277 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-b05aadc4-d5b8-4e98-862a-adc41457da65 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:49.670991 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-b05aadc4-d5b8-4e98-862a-adc41457da65 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3" status: 200 len: 1733 microversion: 2.1 time: 0.233445 May 12 14:52:49.671561 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 308/611] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:52:49 2022] GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3 => generated 1733 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:52:50.690676 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-993726ed-c8dc-4b31-b890-5e06b4d482ff tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:50.691241 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-993726ed-c8dc-4b31-b890-5e06b4d482ff tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 944e4e2e-d09f-4dd7-ac42-b037b09dc7c3] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:52:50.698526 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-993726ed-c8dc-4b31-b890-5e06b4d482ff tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:50.699021 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-993726ed-c8dc-4b31-b890-5e06b4d482ff tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:50.699797 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-993726ed-c8dc-4b31-b890-5e06b4d482ff tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:50.700262 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-993726ed-c8dc-4b31-b890-5e06b4d482ff tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:50.895913 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-993726ed-c8dc-4b31-b890-5e06b4d482ff tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:50.904554 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-993726ed-c8dc-4b31-b890-5e06b4d482ff tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3" status: 200 len: 1733 microversion: 2.1 time: 0.217801 May 12 14:52:50.905116 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 304/612] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:52:50 2022] GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3 => generated 1733 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:52:51.922469 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-e807a9f2-fa97-4380-8e01-67f45b00fcaa tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:51.923119 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-e807a9f2-fa97-4380-8e01-67f45b00fcaa tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 944e4e2e-d09f-4dd7-ac42-b037b09dc7c3] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:52:51.931367 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e807a9f2-fa97-4380-8e01-67f45b00fcaa tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:51.931816 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e807a9f2-fa97-4380-8e01-67f45b00fcaa tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:51.932578 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e807a9f2-fa97-4380-8e01-67f45b00fcaa tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:51.933011 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e807a9f2-fa97-4380-8e01-67f45b00fcaa tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:52.138532 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-e807a9f2-fa97-4380-8e01-67f45b00fcaa tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:52.147882 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-e807a9f2-fa97-4380-8e01-67f45b00fcaa tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3" status: 200 len: 1733 microversion: 2.1 time: 0.229186 May 12 14:52:52.158350 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 309/613] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:52:51 2022] GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3 => generated 1733 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:52:53.165690 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-b102ce2a-812a-40a7-b341-74178065e80c tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:53.166201 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-b102ce2a-812a-40a7-b341-74178065e80c tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 944e4e2e-d09f-4dd7-ac42-b037b09dc7c3] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:52:53.173571 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-b102ce2a-812a-40a7-b341-74178065e80c tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:53.174018 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-b102ce2a-812a-40a7-b341-74178065e80c tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:53.174781 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-b102ce2a-812a-40a7-b341-74178065e80c tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:53.175239 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-b102ce2a-812a-40a7-b341-74178065e80c tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:53.483853 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-b102ce2a-812a-40a7-b341-74178065e80c tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:53.492774 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-b102ce2a-812a-40a7-b341-74178065e80c tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3" status: 200 len: 1733 microversion: 2.1 time: 0.331302 May 12 14:52:53.493285 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 305/614] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:52:53 2022] GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3 => generated 1733 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:52:54.512083 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-3277f64a-ae53-479d-9192-52694dd58984 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:54.512694 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-3277f64a-ae53-479d-9192-52694dd58984 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 944e4e2e-d09f-4dd7-ac42-b037b09dc7c3] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:52:54.519833 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-3277f64a-ae53-479d-9192-52694dd58984 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:54.520283 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-3277f64a-ae53-479d-9192-52694dd58984 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:54.521609 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-3277f64a-ae53-479d-9192-52694dd58984 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:54.522047 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-3277f64a-ae53-479d-9192-52694dd58984 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:54.719123 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-3277f64a-ae53-479d-9192-52694dd58984 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:54.728031 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-3277f64a-ae53-479d-9192-52694dd58984 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3" status: 200 len: 1733 microversion: 2.1 time: 0.219692 May 12 14:52:54.728601 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 310/615] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:52:54 2022] GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3 => generated 1733 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:52:55.745749 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-5ecd2283-8307-43f3-9f09-68a1a0821ca3 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:55.746358 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-5ecd2283-8307-43f3-9f09-68a1a0821ca3 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 944e4e2e-d09f-4dd7-ac42-b037b09dc7c3] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:52:55.753572 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-5ecd2283-8307-43f3-9f09-68a1a0821ca3 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:55.760439 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-5ecd2283-8307-43f3-9f09-68a1a0821ca3 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:55.760439 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-5ecd2283-8307-43f3-9f09-68a1a0821ca3 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:55.760439 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-5ecd2283-8307-43f3-9f09-68a1a0821ca3 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:55.963546 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-5ecd2283-8307-43f3-9f09-68a1a0821ca3 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:55.972229 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-5ecd2283-8307-43f3-9f09-68a1a0821ca3 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3" status: 200 len: 1733 microversion: 2.1 time: 0.230279 May 12 14:52:55.972991 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 306/616] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:52:55 2022] GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3 => generated 1733 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:52:56.988994 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-7a0d1480-2315-4ec9-9feb-f772bcf8328c tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:56.990323 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-7a0d1480-2315-4ec9-9feb-f772bcf8328c tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 944e4e2e-d09f-4dd7-ac42-b037b09dc7c3] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:52:56.997885 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-7a0d1480-2315-4ec9-9feb-f772bcf8328c tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:56.998347 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-7a0d1480-2315-4ec9-9feb-f772bcf8328c tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:56.999144 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-7a0d1480-2315-4ec9-9feb-f772bcf8328c tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:56.999746 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-7a0d1480-2315-4ec9-9feb-f772bcf8328c tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:57.200852 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-7a0d1480-2315-4ec9-9feb-f772bcf8328c tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:57.210732 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-7a0d1480-2315-4ec9-9feb-f772bcf8328c tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3" status: 200 len: 1733 microversion: 2.1 time: 0.225371 May 12 14:52:57.211415 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 311/617] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:52:56 2022] GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3 => generated 1733 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:52:58.228265 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-bd534457-1816-4464-9884-c98bd90cf633 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:58.228881 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-bd534457-1816-4464-9884-c98bd90cf633 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 944e4e2e-d09f-4dd7-ac42-b037b09dc7c3] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:52:58.236002 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-bd534457-1816-4464-9884-c98bd90cf633 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:58.236451 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-bd534457-1816-4464-9884-c98bd90cf633 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:58.237219 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-bd534457-1816-4464-9884-c98bd90cf633 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:58.237656 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-bd534457-1816-4464-9884-c98bd90cf633 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:58.439131 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-bd534457-1816-4464-9884-c98bd90cf633 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:58.449122 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-bd534457-1816-4464-9884-c98bd90cf633 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3" status: 200 len: 1733 microversion: 2.1 time: 0.224680 May 12 14:52:58.449737 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 307/618] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:52:58 2022] GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3 => generated 1733 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:52:59.467152 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-e3d8b278-2d34-4b08-b0c3-7a8e4bdc9744 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:52:59.467770 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-e3d8b278-2d34-4b08-b0c3-7a8e4bdc9744 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 944e4e2e-d09f-4dd7-ac42-b037b09dc7c3] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:52:59.492299 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e3d8b278-2d34-4b08-b0c3-7a8e4bdc9744 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:59.492299 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e3d8b278-2d34-4b08-b0c3-7a8e4bdc9744 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:59.492299 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e3d8b278-2d34-4b08-b0c3-7a8e4bdc9744 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:52:59.492299 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e3d8b278-2d34-4b08-b0c3-7a8e4bdc9744 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:52:59.809773 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-e3d8b278-2d34-4b08-b0c3-7a8e4bdc9744 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:52:59.822703 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-e3d8b278-2d34-4b08-b0c3-7a8e4bdc9744 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3" status: 200 len: 1733 microversion: 2.1 time: 0.358150 May 12 14:52:59.823774 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 312/619] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:52:59 2022] GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3 => generated 1733 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:53:00.842291 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-953f9c75-d528-4c23-b18f-a9c3d4bfa644 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:00.843000 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-953f9c75-d528-4c23-b18f-a9c3d4bfa644 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 944e4e2e-d09f-4dd7-ac42-b037b09dc7c3] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:53:00.852932 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-953f9c75-d528-4c23-b18f-a9c3d4bfa644 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:00.852932 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-953f9c75-d528-4c23-b18f-a9c3d4bfa644 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:00.853620 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-953f9c75-d528-4c23-b18f-a9c3d4bfa644 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:00.854207 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-953f9c75-d528-4c23-b18f-a9c3d4bfa644 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:01.086043 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-953f9c75-d528-4c23-b18f-a9c3d4bfa644 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:53:01.094922 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-953f9c75-d528-4c23-b18f-a9c3d4bfa644 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3" status: 200 len: 1733 microversion: 2.1 time: 0.257034 May 12 14:53:01.095430 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 308/620] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:53:00 2022] GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3 => generated 1733 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:53:02.113246 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-4fce2ea2-cbeb-4b52-96b1-fdf39752a81b tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:02.114110 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-4fce2ea2-cbeb-4b52-96b1-fdf39752a81b tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 944e4e2e-d09f-4dd7-ac42-b037b09dc7c3] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:53:02.121825 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-4fce2ea2-cbeb-4b52-96b1-fdf39752a81b tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:02.122268 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-4fce2ea2-cbeb-4b52-96b1-fdf39752a81b tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:02.123053 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-4fce2ea2-cbeb-4b52-96b1-fdf39752a81b tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:02.123485 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-4fce2ea2-cbeb-4b52-96b1-fdf39752a81b tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:02.326142 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-4fce2ea2-cbeb-4b52-96b1-fdf39752a81b tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:53:02.335709 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-4fce2ea2-cbeb-4b52-96b1-fdf39752a81b tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3" status: 200 len: 1733 microversion: 2.1 time: 0.226146 May 12 14:53:02.336308 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 313/621] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:53:02 2022] GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3 => generated 1733 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:53:03.354290 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-ef2a7d58-0085-433d-b947-c6163555ab41 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:03.354984 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-ef2a7d58-0085-433d-b947-c6163555ab41 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 944e4e2e-d09f-4dd7-ac42-b037b09dc7c3] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:53:03.362300 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-ef2a7d58-0085-433d-b947-c6163555ab41 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:03.362754 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-ef2a7d58-0085-433d-b947-c6163555ab41 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:03.363904 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-ef2a7d58-0085-433d-b947-c6163555ab41 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:03.365083 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-ef2a7d58-0085-433d-b947-c6163555ab41 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:04.051107 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-ef2a7d58-0085-433d-b947-c6163555ab41 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:53:04.061172 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-ef2a7d58-0085-433d-b947-c6163555ab41 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3" status: 200 len: 1713 microversion: 2.1 time: 0.711756 May 12 14:53:04.061867 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 309/622] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:53:03 2022] GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3 => generated 1713 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:53:04.219223 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-de704cb9-6d91-4d6d-8772-d555c22aa15f tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:04.239013 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-de704cb9-6d91-4d6d-8772-d555c22aa15f tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 944e4e2e-d09f-4dd7-ac42-b037b09dc7c3] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:53:04.239013 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-de704cb9-6d91-4d6d-8772-d555c22aa15f tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:04.239013 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-de704cb9-6d91-4d6d-8772-d555c22aa15f tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:04.239013 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-de704cb9-6d91-4d6d-8772-d555c22aa15f tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:04.239434 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-de704cb9-6d91-4d6d-8772-d555c22aa15f tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:04.402728 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.wsgi [None req-de704cb9-6d91-4d6d-8772-d555c22aa15f tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] HTTP exception thrown: Cannot 'detach_volume' instance 944e4e2e-d09f-4dd7-ac42-b037b09dc7c3 while it is in vm_state rescued May 12 14:53:04.403366 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-de704cb9-6d91-4d6d-8772-d555c22aa15f tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Returning 409 to user: Cannot 'detach_volume' instance 944e4e2e-d09f-4dd7-ac42-b037b09dc7c3 while it is in vm_state rescued {{(pid=102213) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 12 14:53:04.404275 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-de704cb9-6d91-4d6d-8772-d555c22aa15f tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "DELETE /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3/os-volume_attachments/88e73d66-9d0e-4fcd-8b2d-61400be6ff03" status: 409 len: 152 microversion: 2.1 time: 0.190386 May 12 14:53:04.404838 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 314/623] 10.222.0.49 () {58 vars in 1415 bytes} [Thu May 12 14:53:04 2022] DELETE /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3/os-volume_attachments/88e73d66-9d0e-4fcd-8b2d-61400be6ff03 => generated 152 bytes in 192 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 12 14:53:04.413711 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-8e77782e-fbbc-45f9-a58c-5da57bd5f7fe tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:53:04.414257 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-8e77782e-fbbc-45f9-a58c-5da57bd5f7fe tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 944e4e2e-d09f-4dd7-ac42-b037b09dc7c3] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:53:04.422502 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-8e77782e-fbbc-45f9-a58c-5da57bd5f7fe tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:04.422994 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-8e77782e-fbbc-45f9-a58c-5da57bd5f7fe tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:04.423797 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-8e77782e-fbbc-45f9-a58c-5da57bd5f7fe tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:04.424241 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-8e77782e-fbbc-45f9-a58c-5da57bd5f7fe tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:05.070839 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-8e77782e-fbbc-45f9-a58c-5da57bd5f7fe tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "POST /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3/action" status: 202 len: 0 microversion: 2.1 time: 0.658496 May 12 14:53:05.070839 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 310/624] 10.222.0.49 () {60 vars in 1277 bytes} [Thu May 12 14:53:04 2022] POST /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3/action => generated 0 bytes in 660 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 14:53:05.077312 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-d7362e28-54d8-4f00-932b-7a0bde04821b tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:05.077947 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-d7362e28-54d8-4f00-932b-7a0bde04821b tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 944e4e2e-d09f-4dd7-ac42-b037b09dc7c3] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:53:05.086642 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-d7362e28-54d8-4f00-932b-7a0bde04821b tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:05.087443 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-d7362e28-54d8-4f00-932b-7a0bde04821b tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:05.088245 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-d7362e28-54d8-4f00-932b-7a0bde04821b tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:05.088704 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-d7362e28-54d8-4f00-932b-7a0bde04821b tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:05.272117 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-b7fd6bd0-07e5-403b-a71b-6e06f373e6d3 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:05.274168 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-b7fd6bd0-07e5-403b-a71b-6e06f373e6d3 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 3062e66d-4c2a-4212-b186-ecafec6bde2e] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:53:05.297280 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-b7fd6bd0-07e5-403b-a71b-6e06f373e6d3 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:05.297280 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-b7fd6bd0-07e5-403b-a71b-6e06f373e6d3 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:05.297280 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-b7fd6bd0-07e5-403b-a71b-6e06f373e6d3 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:05.297280 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-b7fd6bd0-07e5-403b-a71b-6e06f373e6d3 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:05.442355 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-b7fd6bd0-07e5-403b-a71b-6e06f373e6d3 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.175985 May 12 14:53:05.443060 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 311/625] 10.222.0.49 () {58 vars in 1301 bytes} [Thu May 12 14:53:05 2022] GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e/os-volume_attachments => generated 25 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 12 14:53:05.465264 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-d7362e28-54d8-4f00-932b-7a0bde04821b tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:53:05.480504 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-d7362e28-54d8-4f00-932b-7a0bde04821b tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3" status: 200 len: 1721 microversion: 2.1 time: 0.406775 May 12 14:53:05.481397 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 315/626] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:53:05 2022] GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3 => generated 1721 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:53:05.551432 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-fbbe5e92-3cc3-4357-a3b7-42fc7dc8399d tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:05.555387 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-fbbe5e92-3cc3-4357-a3b7-42fc7dc8399d tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 3062e66d-4c2a-4212-b186-ecafec6bde2e] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:53:05.564235 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-fbbe5e92-3cc3-4357-a3b7-42fc7dc8399d tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:05.565015 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-fbbe5e92-3cc3-4357-a3b7-42fc7dc8399d tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:05.566031 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-fbbe5e92-3cc3-4357-a3b7-42fc7dc8399d tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:05.566668 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-fbbe5e92-3cc3-4357-a3b7-42fc7dc8399d tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:05.655030 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-fbbe5e92-3cc3-4357-a3b7-42fc7dc8399d tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 3062e66d-4c2a-4212-b186-ecafec6bde2e] Going to try to terminate instance {{(pid=102212) delete /opt/stack/nova/nova/compute/api.py:2562}} May 12 14:53:06.166894 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-fbbe5e92-3cc3-4357-a3b7-42fc7dc8399d tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "DELETE /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e" status: 204 len: 0 microversion: 2.1 time: 0.618909 May 12 14:53:06.167895 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 312/627] 10.222.0.49 () {58 vars in 1238 bytes} [Thu May 12 14:53:05 2022] DELETE /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e => generated 0 bytes in 621 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 14:53:06.176111 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-42ca6e3b-ec79-429c-abc2-d507fb6b6fe5 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:06.186929 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-42ca6e3b-ec79-429c-abc2-d507fb6b6fe5 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 3062e66d-4c2a-4212-b186-ecafec6bde2e] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:53:06.186929 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-42ca6e3b-ec79-429c-abc2-d507fb6b6fe5 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:06.186929 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-42ca6e3b-ec79-429c-abc2-d507fb6b6fe5 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:06.186929 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-42ca6e3b-ec79-429c-abc2-d507fb6b6fe5 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:06.187476 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-42ca6e3b-ec79-429c-abc2-d507fb6b6fe5 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:06.433847 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-42ca6e3b-ec79-429c-abc2-d507fb6b6fe5 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e128ca83d6448c9ab1fe7dcc5467d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a090a68e336b4562aca524a95f550e04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:53:06.449568 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-42ca6e3b-ec79-429c-abc2-d507fb6b6fe5 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e" status: 200 len: 1675 microversion: 2.1 time: 0.274873 May 12 14:53:06.450746 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 316/628] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:53:06 2022] GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e => generated 1675 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:53:06.499575 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-86c8a28e-cdbf-452d-bf7f-308737a6cbfb tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:06.501147 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-86c8a28e-cdbf-452d-bf7f-308737a6cbfb tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 944e4e2e-d09f-4dd7-ac42-b037b09dc7c3] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:53:06.514141 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-86c8a28e-cdbf-452d-bf7f-308737a6cbfb tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:06.515167 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-86c8a28e-cdbf-452d-bf7f-308737a6cbfb tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:06.516219 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-86c8a28e-cdbf-452d-bf7f-308737a6cbfb tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:06.517576 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-86c8a28e-cdbf-452d-bf7f-308737a6cbfb tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:07.037439 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-86c8a28e-cdbf-452d-bf7f-308737a6cbfb tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:53:07.048442 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-86c8a28e-cdbf-452d-bf7f-308737a6cbfb tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3" status: 200 len: 1721 microversion: 2.1 time: 0.554484 May 12 14:53:07.049584 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 313/629] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:53:06 2022] GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3 => generated 1721 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:53:07.467729 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-ac229362-21db-4a68-8408-a12198ec6dd3 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:07.468496 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-ac229362-21db-4a68-8408-a12198ec6dd3 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 3062e66d-4c2a-4212-b186-ecafec6bde2e] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:53:07.478891 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-ac229362-21db-4a68-8408-a12198ec6dd3 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:07.479607 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-ac229362-21db-4a68-8408-a12198ec6dd3 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:07.480483 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-ac229362-21db-4a68-8408-a12198ec6dd3 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:07.481120 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-ac229362-21db-4a68-8408-a12198ec6dd3 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:07.783586 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-ac229362-21db-4a68-8408-a12198ec6dd3 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e128ca83d6448c9ab1fe7dcc5467d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a090a68e336b4562aca524a95f550e04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:53:07.793971 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-ac229362-21db-4a68-8408-a12198ec6dd3 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e" status: 200 len: 1675 microversion: 2.1 time: 0.330031 May 12 14:53:07.794842 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 317/630] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:53:07 2022] GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e => generated 1675 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:53:08.065943 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-5ed56c78-4f9d-473f-a0ee-d706b9e0d2d7 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:08.066665 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-5ed56c78-4f9d-473f-a0ee-d706b9e0d2d7 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 944e4e2e-d09f-4dd7-ac42-b037b09dc7c3] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:53:08.075115 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-5ed56c78-4f9d-473f-a0ee-d706b9e0d2d7 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:08.075568 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-5ed56c78-4f9d-473f-a0ee-d706b9e0d2d7 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:08.076352 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-5ed56c78-4f9d-473f-a0ee-d706b9e0d2d7 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:08.076824 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-5ed56c78-4f9d-473f-a0ee-d706b9e0d2d7 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:08.456015 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-5ed56c78-4f9d-473f-a0ee-d706b9e0d2d7 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:53:08.465948 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-5ed56c78-4f9d-473f-a0ee-d706b9e0d2d7 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3" status: 200 len: 1721 microversion: 2.1 time: 0.403675 May 12 14:53:08.468894 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 314/631] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:53:08 2022] GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3 => generated 1721 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:53:08.810887 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-42f28ae0-59ff-4a61-b228-908a74e07223 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:08.811507 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-42f28ae0-59ff-4a61-b228-908a74e07223 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 3062e66d-4c2a-4212-b186-ecafec6bde2e] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:53:08.819561 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-42f28ae0-59ff-4a61-b228-908a74e07223 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:08.820012 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-42f28ae0-59ff-4a61-b228-908a74e07223 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:08.820787 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-42f28ae0-59ff-4a61-b228-908a74e07223 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:08.821217 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-42f28ae0-59ff-4a61-b228-908a74e07223 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:09.056389 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-42f28ae0-59ff-4a61-b228-908a74e07223 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e128ca83d6448c9ab1fe7dcc5467d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a090a68e336b4562aca524a95f550e04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:53:09.058202 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-42f28ae0-59ff-4a61-b228-908a74e07223 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e" status: 200 len: 1675 microversion: 2.1 time: 0.250939 May 12 14:53:09.059115 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 318/632] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:53:08 2022] GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e => generated 1675 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:53:09.483747 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-353b374b-771a-4c29-b74f-9ef320c1d695 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:09.484343 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-353b374b-771a-4c29-b74f-9ef320c1d695 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 944e4e2e-d09f-4dd7-ac42-b037b09dc7c3] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:53:09.496978 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-353b374b-771a-4c29-b74f-9ef320c1d695 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:09.497829 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-353b374b-771a-4c29-b74f-9ef320c1d695 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:09.498985 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-353b374b-771a-4c29-b74f-9ef320c1d695 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:09.499456 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-353b374b-771a-4c29-b74f-9ef320c1d695 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:10.044198 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-353b374b-771a-4c29-b74f-9ef320c1d695 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:53:10.055261 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-353b374b-771a-4c29-b74f-9ef320c1d695 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3" status: 200 len: 1721 microversion: 2.1 time: 0.575157 May 12 14:53:10.064915 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 315/633] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:53:09 2022] GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3 => generated 1721 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:53:10.077107 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-71590507-269e-4e20-8954-e2bef826abda tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:10.077716 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-71590507-269e-4e20-8954-e2bef826abda tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 3062e66d-4c2a-4212-b186-ecafec6bde2e] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:53:10.085323 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-71590507-269e-4e20-8954-e2bef826abda tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:10.085780 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-71590507-269e-4e20-8954-e2bef826abda tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:10.086563 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-71590507-269e-4e20-8954-e2bef826abda tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:10.087029 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-71590507-269e-4e20-8954-e2bef826abda tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:10.320319 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-71590507-269e-4e20-8954-e2bef826abda tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e128ca83d6448c9ab1fe7dcc5467d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a090a68e336b4562aca524a95f550e04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:53:10.329208 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-71590507-269e-4e20-8954-e2bef826abda tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e" status: 200 len: 1675 microversion: 2.1 time: 0.256039 May 12 14:53:10.329875 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 319/634] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:53:10 2022] GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e => generated 1675 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:53:10.876916 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [req-e848dba3-9a2e-4c23-a7ab-ae23136a404c req-75988963-c638-4a6b-ad32-df60d5132a3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3062e66d-4c2a-4212-b186-ecafec6bde2e", "name": "network-vif-deleted", "tag": "dc63b69d-a47c-45f7-a4ec-c94b33fcef39"}]} {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:53:10.878591 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:53:10.878591 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: warnings.warn(msg) May 12 14:53:10.899336 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [req-e848dba3-9a2e-4c23-a7ab-ae23136a404c req-75988963-c638-4a6b-ad32-df60d5132a3e service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:10.902616 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [req-e848dba3-9a2e-4c23-a7ab-ae23136a404c req-75988963-c638-4a6b-ad32-df60d5132a3e service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:10.946883 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.compute.server_external_events [req-e848dba3-9a2e-4c23-a7ab-ae23136a404c req-75988963-c638-4a6b-ad32-df60d5132a3e service nova] Creating event network-vif-deleted:dc63b69d-a47c-45f7-a4ec-c94b33fcef39 for instance 3062e66d-4c2a-4212-b186-ecafec6bde2e on hv-cinder-83118 May 12 14:53:10.955031 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [req-e848dba3-9a2e-4c23-a7ab-ae23136a404c req-75988963-c638-4a6b-ad32-df60d5132a3e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085509 May 12 14:53:10.960618 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 316/635] 10.222.0.49 () {64 vars in 1317 bytes} [Thu May 12 14:53:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:53:11.072705 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-5fd06a80-0ff8-49c9-b4dd-5d7533013a53 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:11.073402 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-5fd06a80-0ff8-49c9-b4dd-5d7533013a53 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 944e4e2e-d09f-4dd7-ac42-b037b09dc7c3] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:53:11.080802 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-5fd06a80-0ff8-49c9-b4dd-5d7533013a53 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:11.081992 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-5fd06a80-0ff8-49c9-b4dd-5d7533013a53 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:11.082856 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-5fd06a80-0ff8-49c9-b4dd-5d7533013a53 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:11.083358 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-5fd06a80-0ff8-49c9-b4dd-5d7533013a53 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:11.352546 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-5fd06a80-0ff8-49c9-b4dd-5d7533013a53 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:53:11.354630 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-77e37644-ce53-4b13-ae51-0a946c49b00a tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:11.355848 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-77e37644-ce53-4b13-ae51-0a946c49b00a tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 3062e66d-4c2a-4212-b186-ecafec6bde2e] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:53:11.362695 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-5fd06a80-0ff8-49c9-b4dd-5d7533013a53 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3" status: 200 len: 1727 microversion: 2.1 time: 0.293744 May 12 14:53:11.364066 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 320/636] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:53:11 2022] GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3 => generated 1727 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:53:11.391755 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-77e37644-ce53-4b13-ae51-0a946c49b00a tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:11.392212 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-77e37644-ce53-4b13-ae51-0a946c49b00a tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:11.393182 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-77e37644-ce53-4b13-ae51-0a946c49b00a tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:11.394023 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-0d6b040b-c703-4ae7-8548-73465ac6fe4b tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:11.394166 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-77e37644-ce53-4b13-ae51-0a946c49b00a tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:11.394891 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-0d6b040b-c703-4ae7-8548-73465ac6fe4b tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 944e4e2e-d09f-4dd7-ac42-b037b09dc7c3] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:53:11.403661 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-0d6b040b-c703-4ae7-8548-73465ac6fe4b tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:11.404594 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-0d6b040b-c703-4ae7-8548-73465ac6fe4b tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:11.405733 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-0d6b040b-c703-4ae7-8548-73465ac6fe4b tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:11.406412 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-0d6b040b-c703-4ae7-8548-73465ac6fe4b tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:11.498475 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-77e37644-ce53-4b13-ae51-0a946c49b00a tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:11.500047 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-77e37644-ce53-4b13-ae51-0a946c49b00a tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:11.500667 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.objects.instance [None req-77e37644-ce53-4b13-ae51-0a946c49b00a tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lazy-loading 'fault' on Instance uuid 3062e66d-4c2a-4212-b186-ecafec6bde2e {{(pid=102212) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 12 14:53:11.668367 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-0d6b040b-c703-4ae7-8548-73465ac6fe4b tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.291956 May 12 14:53:11.669157 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 321/637] 10.222.0.49 () {58 vars in 1274 bytes} [Thu May 12 14:53:11 2022] GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3/os-interface => generated 284 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:53:11.742883 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-77e37644-ce53-4b13-ae51-0a946c49b00a tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e128ca83d6448c9ab1fe7dcc5467d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a090a68e336b4562aca524a95f550e04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:53:11.752779 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-77e37644-ce53-4b13-ae51-0a946c49b00a tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e" status: 200 len: 1328 microversion: 2.1 time: 0.409432 May 12 14:53:11.764059 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 317/638] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:53:11 2022] GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e => generated 1328 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:53:12.772138 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-fb9d727c-9b74-44b3-8665-21aa9fe1868d tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:12.774020 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-fb9d727c-9b74-44b3-8665-21aa9fe1868d tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 3062e66d-4c2a-4212-b186-ecafec6bde2e] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:53:12.814701 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-fb9d727c-9b74-44b3-8665-21aa9fe1868d tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:12.833374 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-fb9d727c-9b74-44b3-8665-21aa9fe1868d tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:12.834376 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-fb9d727c-9b74-44b3-8665-21aa9fe1868d tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:12.834892 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-fb9d727c-9b74-44b3-8665-21aa9fe1868d tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:12.959044 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.wsgi [None req-fb9d727c-9b74-44b3-8665-21aa9fe1868d tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] HTTP exception thrown: Instance 3062e66d-4c2a-4212-b186-ecafec6bde2e could not be found. May 12 14:53:12.959661 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-fb9d727c-9b74-44b3-8665-21aa9fe1868d tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Returning 404 to user: Instance 3062e66d-4c2a-4212-b186-ecafec6bde2e could not be found. {{(pid=102213) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 12 14:53:12.960538 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-fb9d727c-9b74-44b3-8665-21aa9fe1868d tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e" status: 404 len: 111 microversion: 2.1 time: 0.193388 May 12 14:53:12.962003 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 322/639] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:53:12 2022] GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e => generated 111 bytes in 195 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 14:53:12.970427 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-6b700e34-ffd6-4a12-999a-577920262639 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Calling method '.version_select at 0x7ff77fbdbdc0>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:13.106020 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-6b700e34-ffd6-4a12-999a-577920262639 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1676010479" status: 202 len: 0 microversion: 2.1 time: 0.139361 May 12 14:53:13.107084 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 318/640] 10.222.0.49 () {58 vars in 1220 bytes} [Thu May 12 14:53:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1676010479 => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 14:53:13.708466 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [req-50d0d6d8-7509-4c9f-96ae-a3486043d868 req-e6b94632-9343-4c0c-b443-42a361255d5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "944e4e2e-d09f-4dd7-ac42-b037b09dc7c3", "tag": "cb1e67a7-74a2-404f-8058-06c175243b15"}]} {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:53:13.710214 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:53:13.710214 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: warnings.warn(msg) May 12 14:53:13.726398 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [req-50d0d6d8-7509-4c9f-96ae-a3486043d868 req-e6b94632-9343-4c0c-b443-42a361255d5e service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:13.727398 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [req-50d0d6d8-7509-4c9f-96ae-a3486043d868 req-e6b94632-9343-4c0c-b443-42a361255d5e service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:13.772302 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.compute.server_external_events [req-50d0d6d8-7509-4c9f-96ae-a3486043d868 req-e6b94632-9343-4c0c-b443-42a361255d5e service nova] Creating event network-changed:cb1e67a7-74a2-404f-8058-06c175243b15 for instance 944e4e2e-d09f-4dd7-ac42-b037b09dc7c3 on hv-cinder-83118 May 12 14:53:13.779012 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [req-50d0d6d8-7509-4c9f-96ae-a3486043d868 req-e6b94632-9343-4c0c-b443-42a361255d5e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074872 May 12 14:53:13.782511 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 323/641] 10.222.0.49 () {64 vars in 1317 bytes} [Thu May 12 14:53:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:53:15.760401 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-2e1ea3b3-690c-45ef-91fb-f1ddfe7ee0f6 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Action: 'create', calling method: .version_select at 0x7ff77e5498b0>, body: {"keypair": {"name": "tempest-keypair-1487316631", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKZuc/DY4li8qHGUUm9Y5HOQQR8IiGmUIaK6do8Uw4KdlljD069ZcQkn1KjG26aqHcvRZniE4UNxSPb7GYK/1xS15XPn/N3Lor2LUamfHji/omJlxx5i7QQszY7+C+H8/w=="}} {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:53:15.789654 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.quota [None req-2e1ea3b3-690c-45ef-91fb-f1ddfe7ee0f6 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Getting quotas for project a090a68e336b4562aca524a95f550e04. Resources: {'key_pairs'} {{(pid=102212) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 12 14:53:15.794148 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.quota [None req-2e1ea3b3-690c-45ef-91fb-f1ddfe7ee0f6 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Getting quotas for user b0e128ca83d6448c9ab1fe7dcc5467d4 and project a090a68e336b4562aca524a95f550e04. Resources: {'key_pairs'} {{(pid=102212) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 12 14:53:15.797292 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [req-77416b18-ce59-4b37-aebd-bb5555d02351 req-f3a89eeb-1a93-4d22-b886-8a6e6563fd4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "944e4e2e-d09f-4dd7-ac42-b037b09dc7c3", "tag": "cb1e67a7-74a2-404f-8058-06c175243b15"}]} {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:53:15.798803 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:53:15.798803 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: warnings.warn(msg) May 12 14:53:15.813421 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [req-77416b18-ce59-4b37-aebd-bb5555d02351 req-f3a89eeb-1a93-4d22-b886-8a6e6563fd4d service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:15.814000 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [req-77416b18-ce59-4b37-aebd-bb5555d02351 req-f3a89eeb-1a93-4d22-b886-8a6e6563fd4d service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:15.836328 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.compute.server_external_events [req-77416b18-ce59-4b37-aebd-bb5555d02351 req-f3a89eeb-1a93-4d22-b886-8a6e6563fd4d service nova] Creating event network-changed:cb1e67a7-74a2-404f-8058-06c175243b15 for instance 944e4e2e-d09f-4dd7-ac42-b037b09dc7c3 on hv-cinder-83118 May 12 14:53:15.841416 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [req-77416b18-ce59-4b37-aebd-bb5555d02351 req-f3a89eeb-1a93-4d22-b886-8a6e6563fd4d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048153 May 12 14:53:15.842220 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 324/642] 10.222.0.49 () {64 vars in 1317 bytes} [Thu May 12 14:53:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:53:15.947142 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-2e1ea3b3-690c-45ef-91fb-f1ddfe7ee0f6 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.193712 May 12 14:53:15.948789 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 319/643] 10.222.0.49 () {60 vars in 1158 bytes} [Thu May 12 14:53:15 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:53:19.781644 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-d6890273-77b0-4231-9c1b-ffcd8396a1b6 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1013598076", "imageRef": "a4587ab2-5f51-46a3-a023-0e6778ccaaa1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "42e9462e-79bf-4236-9d9e-1261c021234a"}], "security_groups": [{"name": "tempest-securitygroup--1423868444"}], "key_name": "tempest-keypair-1487316631", "user_data": "}} {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:53:20.147352 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.network.neutron [None req-d6890273-77b0-4231-9c1b-ffcd8396a1b6 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] validate_networks() for [('42e9462e-79bf-4236-9d9e-1261c021234a', None, None, None)] {{(pid=102213) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} May 12 14:53:21.311478 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.virt.hardware [None req-d6890273-77b0-4231-9c1b-ffcd8396a1b6 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Flavor limits 0:0:0 {{(pid=102213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 14:53:21.312160 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.virt.hardware [None req-d6890273-77b0-4231-9c1b-ffcd8396a1b6 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Image limits 0:0:0 {{(pid=102213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 14:53:21.312783 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.virt.hardware [None req-d6890273-77b0-4231-9c1b-ffcd8396a1b6 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Flavor pref 0:0:0 {{(pid=102213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 14:53:21.313542 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.virt.hardware [None req-d6890273-77b0-4231-9c1b-ffcd8396a1b6 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Image pref 0:0:0 {{(pid=102213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 14:53:21.315397 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.virt.hardware [None req-d6890273-77b0-4231-9c1b-ffcd8396a1b6 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=102213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 14:53:21.324992 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-d6890273-77b0-4231-9c1b-ffcd8396a1b6 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:21.325594 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-d6890273-77b0-4231-9c1b-ffcd8396a1b6 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:21.326657 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-d6890273-77b0-4231-9c1b-ffcd8396a1b6 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:21.327352 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-d6890273-77b0-4231-9c1b-ffcd8396a1b6 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:21.355084 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.quota [None req-d6890273-77b0-4231-9c1b-ffcd8396a1b6 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Getting quotas for project a090a68e336b4562aca524a95f550e04. Resources: {'cores', 'ram', 'instances'} {{(pid=102213) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 12 14:53:21.356458 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-b1882fd6-eca8-47f7-b871-768c86ef7600 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Action: 'create', calling method: .version_select at 0x7ff77e7833a0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1481799217", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMJtUKIXAlX8MUtwsI9YXL3YwSSBhQH09x9PFBNkiJZlk6bWN9EQxFK684Fviuu7m2CY/UAzIByVxNVY6Si0y/QtpJTg6wDcU1VxXf+0+MtY35M5YhFN/QunzR5WnRmWtg=="}} {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:53:21.360350 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.quota [None req-d6890273-77b0-4231-9c1b-ffcd8396a1b6 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Getting quotas for user b0e128ca83d6448c9ab1fe7dcc5467d4 and project a090a68e336b4562aca524a95f550e04. Resources: {'cores', 'ram', 'instances'} {{(pid=102213) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 12 14:53:21.373865 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-d6890273-77b0-4231-9c1b-ffcd8396a1b6 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Going to run 1 instances... {{(pid=102213) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 12 14:53:21.376762 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-d6890273-77b0-4231-9c1b-ffcd8396a1b6 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 358a3c59-ec18-40a6-b2a2-d7a37b46d08f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a4587ab2-5f51-46a3-a023-0e6778ccaaa1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=102213) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} May 12 14:53:21.398561 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.quota [None req-b1882fd6-eca8-47f7-b871-768c86ef7600 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Getting quotas for project 235689d103ed4d0dbe7b78698395bd21. Resources: {'key_pairs'} {{(pid=102212) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 12 14:53:21.407284 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.quota [None req-b1882fd6-eca8-47f7-b871-768c86ef7600 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Getting quotas for user fef8036bc3ad4725b3af2607ceb17c88 and project 235689d103ed4d0dbe7b78698395bd21. Resources: {'key_pairs'} {{(pid=102212) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 12 14:53:21.523578 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-b1882fd6-eca8-47f7-b871-768c86ef7600 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.368667 May 12 14:53:21.524559 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 320/644] 10.222.0.49 () {60 vars in 1158 bytes} [Thu May 12 14:53:21 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 14:53:21.575683 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-d6890273-77b0-4231-9c1b-ffcd8396a1b6 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.798965 May 12 14:53:21.578107 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 325/645] 10.222.0.49 () {60 vars in 1146 bytes} [Thu May 12 14:53:19 2022] POST /compute/v2.1/servers => generated 402 bytes in 1801 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 14:53:21.586314 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-3141feaa-6abd-4159-9b23-3afb9578e0cc tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:21.587092 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-3141feaa-6abd-4159-9b23-3afb9578e0cc tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 358a3c59-ec18-40a6-b2a2-d7a37b46d08f] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:53:21.794719 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-0354be80-66d6-4666-803f-b6bc83e91fba tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:21.795439 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-0354be80-66d6-4666-803f-b6bc83e91fba tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 6f7de537-3c2b-4b45-a0da-e5b9ab7c169a] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:53:21.806188 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-3141feaa-6abd-4159-9b23-3afb9578e0cc tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e128ca83d6448c9ab1fe7dcc5467d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a090a68e336b4562aca524a95f550e04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:53:21.816053 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-0354be80-66d6-4666-803f-b6bc83e91fba tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:21.816739 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-0354be80-66d6-4666-803f-b6bc83e91fba tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:21.817642 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-0354be80-66d6-4666-803f-b6bc83e91fba tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:21.818159 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-0354be80-66d6-4666-803f-b6bc83e91fba tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:21.818709 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-3141feaa-6abd-4159-9b23-3afb9578e0cc tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "GET /compute/v2.1/servers/358a3c59-ec18-40a6-b2a2-d7a37b46d08f" status: 200 len: 1238 microversion: 2.1 time: 0.235234 May 12 14:53:21.819478 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 321/646] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:53:21 2022] GET /compute/v2.1/servers/358a3c59-ec18-40a6-b2a2-d7a37b46d08f => generated 1238 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:53:21.900856 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-0354be80-66d6-4666-803f-b6bc83e91fba tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/6f7de537-3c2b-4b45-a0da-e5b9ab7c169a/ips" status: 200 len: 150 microversion: 2.1 time: 0.111148 May 12 14:53:21.901703 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 326/647] 10.222.0.49 () {58 vars in 1247 bytes} [Thu May 12 14:53:21 2022] GET /compute/v2.1/servers/6f7de537-3c2b-4b45-a0da-e5b9ab7c169a/ips => generated 150 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:53:22.836058 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-c8ea8dc6-6e34-4942-9ad8-73561a25111a tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:22.836856 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-c8ea8dc6-6e34-4942-9ad8-73561a25111a tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 358a3c59-ec18-40a6-b2a2-d7a37b46d08f] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:53:22.926273 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-c8ea8dc6-6e34-4942-9ad8-73561a25111a tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e128ca83d6448c9ab1fe7dcc5467d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a090a68e336b4562aca524a95f550e04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:53:22.937455 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-c8ea8dc6-6e34-4942-9ad8-73561a25111a tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "GET /compute/v2.1/servers/358a3c59-ec18-40a6-b2a2-d7a37b46d08f" status: 200 len: 1238 microversion: 2.1 time: 0.102394 May 12 14:53:22.937455 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 322/648] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:53:22 2022] GET /compute/v2.1/servers/358a3c59-ec18-40a6-b2a2-d7a37b46d08f => generated 1238 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:53:23.953394 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-bec689d4-d26d-4727-a281-42e7dca61b81 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:23.954016 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-bec689d4-d26d-4727-a281-42e7dca61b81 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 358a3c59-ec18-40a6-b2a2-d7a37b46d08f] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:53:23.963760 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-bec689d4-d26d-4727-a281-42e7dca61b81 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:23.969263 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-bec689d4-d26d-4727-a281-42e7dca61b81 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:23.969263 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-bec689d4-d26d-4727-a281-42e7dca61b81 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:23.969263 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-bec689d4-d26d-4727-a281-42e7dca61b81 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:24.011082 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-da04ecc7-b23f-42b5-80f3-cab004c15219 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d9da0915-9ff9-4e36-ad32-c97a7a5dea8c"}} {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:53:24.012757 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-da04ecc7-b23f-42b5-80f3-cab004c15219 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 6f7de537-3c2b-4b45-a0da-e5b9ab7c169a] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:53:24.024233 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-da04ecc7-b23f-42b5-80f3-cab004c15219 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:24.026626 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-da04ecc7-b23f-42b5-80f3-cab004c15219 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:24.026626 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-da04ecc7-b23f-42b5-80f3-cab004c15219 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:24.026626 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-da04ecc7-b23f-42b5-80f3-cab004c15219 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:24.154215 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-bec689d4-d26d-4727-a281-42e7dca61b81 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e128ca83d6448c9ab1fe7dcc5467d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a090a68e336b4562aca524a95f550e04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:53:24.166285 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-bec689d4-d26d-4727-a281-42e7dca61b81 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "GET /compute/v2.1/servers/358a3c59-ec18-40a6-b2a2-d7a37b46d08f" status: 200 len: 1234 microversion: 2.1 time: 0.216091 May 12 14:53:24.177722 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 327/649] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:53:23 2022] GET /compute/v2.1/servers/358a3c59-ec18-40a6-b2a2-d7a37b46d08f => generated 1234 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:53:25.164251 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-da04ecc7-b23f-42b5-80f3-cab004c15219 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "POST /compute/v2.1/servers/6f7de537-3c2b-4b45-a0da-e5b9ab7c169a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.156583 May 12 14:53:25.166304 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 323/650] 10.222.0.49 () {60 vars in 1322 bytes} [Thu May 12 14:53:24 2022] POST /compute/v2.1/servers/6f7de537-3c2b-4b45-a0da-e5b9ab7c169a/os-volume_attachments => generated 194 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 14:53:25.187342 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-5fcc5ee8-f5ff-4f19-9be8-e1728b8edef8 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:25.193162 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-5fcc5ee8-f5ff-4f19-9be8-e1728b8edef8 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 358a3c59-ec18-40a6-b2a2-d7a37b46d08f] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:53:25.200794 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-5fcc5ee8-f5ff-4f19-9be8-e1728b8edef8 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:25.201599 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-5fcc5ee8-f5ff-4f19-9be8-e1728b8edef8 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:25.203170 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-5fcc5ee8-f5ff-4f19-9be8-e1728b8edef8 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:25.203877 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-5fcc5ee8-f5ff-4f19-9be8-e1728b8edef8 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:25.370228 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-5fcc5ee8-f5ff-4f19-9be8-e1728b8edef8 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e128ca83d6448c9ab1fe7dcc5467d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a090a68e336b4562aca524a95f550e04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:53:25.383530 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-5fcc5ee8-f5ff-4f19-9be8-e1728b8edef8 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "GET /compute/v2.1/servers/358a3c59-ec18-40a6-b2a2-d7a37b46d08f" status: 200 len: 1298 microversion: 2.1 time: 0.203207 May 12 14:53:25.394146 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 328/651] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:53:25 2022] GET /compute/v2.1/servers/358a3c59-ec18-40a6-b2a2-d7a37b46d08f => generated 1298 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:53:25.454109 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-e475b26d-3cd0-4ddd-94ed-37ae6d565bdd tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:25.455363 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-e475b26d-3cd0-4ddd-94ed-37ae6d565bdd tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:53:25.464860 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-e475b26d-3cd0-4ddd-94ed-37ae6d565bdd tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:25.466192 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-e475b26d-3cd0-4ddd-94ed-37ae6d565bdd tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:25.467275 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-e475b26d-3cd0-4ddd-94ed-37ae6d565bdd tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:25.467960 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-e475b26d-3cd0-4ddd-94ed-37ae6d565bdd tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:25.567781 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-e475b26d-3cd0-4ddd-94ed-37ae6d565bdd tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9/os-volume_attachments/548229b6-b184-497b-9792-cc3455d79ad7" status: 200 len: 194 microversion: 2.20 time: 0.117526 May 12 14:53:25.567937 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 324/652] 10.222.0.49 () {60 vars in 1453 bytes} [Thu May 12 14:53:25 2022] GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9/os-volume_attachments/548229b6-b184-497b-9792-cc3455d79ad7 => generated 194 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 12 14:53:25.671031 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-a4089764-c459-4cb8-a0ce-9c38d2bfec97 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:25.671524 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-a4089764-c459-4cb8-a0ce-9c38d2bfec97 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:53:25.679017 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-a4089764-c459-4cb8-a0ce-9c38d2bfec97 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:25.679679 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-a4089764-c459-4cb8-a0ce-9c38d2bfec97 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:25.680595 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-a4089764-c459-4cb8-a0ce-9c38d2bfec97 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:25.681178 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-a4089764-c459-4cb8-a0ce-9c38d2bfec97 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:25.901175 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.objects.instance [None req-a4089764-c459-4cb8-a0ce-9c38d2bfec97 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lazy-loading 'services' on Instance uuid a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9 {{(pid=102213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 12 14:53:26.300137 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-a4089764-c459-4cb8-a0ce-9c38d2bfec97 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "DELETE /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9/os-volume_attachments/548229b6-b184-497b-9792-cc3455d79ad7" status: 202 len: 0 microversion: 2.20 time: 0.631956 May 12 14:53:26.306648 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 329/653] 10.222.0.49 () {60 vars in 1456 bytes} [Thu May 12 14:53:25 2022] DELETE /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9/os-volume_attachments/548229b6-b184-497b-9792-cc3455d79ad7 => generated 0 bytes in 635 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 12 14:53:26.312541 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-b98f1015-b3da-41da-8055-e094da2827da tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:26.316308 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-b98f1015-b3da-41da-8055-e094da2827da tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:53:26.327029 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-b98f1015-b3da-41da-8055-e094da2827da tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:26.327029 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-b98f1015-b3da-41da-8055-e094da2827da tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:26.327029 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-b98f1015-b3da-41da-8055-e094da2827da tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:26.327029 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-b98f1015-b3da-41da-8055-e094da2827da tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:26.401857 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-8118a9ae-77bb-43e6-b0e1-bb2aa7499555 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:26.406710 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-8118a9ae-77bb-43e6-b0e1-bb2aa7499555 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 358a3c59-ec18-40a6-b2a2-d7a37b46d08f] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:53:26.428660 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-b98f1015-b3da-41da-8055-e094da2827da tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.119804 May 12 14:53:26.428660 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 325/654] 10.222.0.49 () {60 vars in 1342 bytes} [Thu May 12 14:53:26 2022] GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9/os-volume_attachments => generated 197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 12 14:53:26.434181 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-8118a9ae-77bb-43e6-b0e1-bb2aa7499555 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:26.434632 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-8118a9ae-77bb-43e6-b0e1-bb2aa7499555 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:26.435447 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-8118a9ae-77bb-43e6-b0e1-bb2aa7499555 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:26.435878 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-8118a9ae-77bb-43e6-b0e1-bb2aa7499555 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:26.654179 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-8118a9ae-77bb-43e6-b0e1-bb2aa7499555 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e128ca83d6448c9ab1fe7dcc5467d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a090a68e336b4562aca524a95f550e04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:53:26.663900 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-8118a9ae-77bb-43e6-b0e1-bb2aa7499555 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "GET /compute/v2.1/servers/358a3c59-ec18-40a6-b2a2-d7a37b46d08f" status: 200 len: 1364 microversion: 2.1 time: 0.266278 May 12 14:53:26.664603 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 330/655] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:53:26 2022] GET /compute/v2.1/servers/358a3c59-ec18-40a6-b2a2-d7a37b46d08f => generated 1364 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:53:27.441316 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-1dcfa259-1a27-4df6-99b9-c50a008bc3f5 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:27.442265 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-1dcfa259-1a27-4df6-99b9-c50a008bc3f5 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:53:27.450365 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-1dcfa259-1a27-4df6-99b9-c50a008bc3f5 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:27.451294 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-1dcfa259-1a27-4df6-99b9-c50a008bc3f5 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:27.452069 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-1dcfa259-1a27-4df6-99b9-c50a008bc3f5 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:27.452500 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-1dcfa259-1a27-4df6-99b9-c50a008bc3f5 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:27.533098 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-1dcfa259-1a27-4df6-99b9-c50a008bc3f5 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.096083 May 12 14:53:27.534144 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 326/656] 10.222.0.49 () {60 vars in 1342 bytes} [Thu May 12 14:53:27 2022] GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 14:53:27.681466 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-5bfbf733-038a-4bb1-a989-5eda32477dab tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:27.682644 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-5bfbf733-038a-4bb1-a989-5eda32477dab tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 358a3c59-ec18-40a6-b2a2-d7a37b46d08f] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:53:27.691683 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-5bfbf733-038a-4bb1-a989-5eda32477dab tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:27.692202 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-5bfbf733-038a-4bb1-a989-5eda32477dab tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:27.693063 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-5bfbf733-038a-4bb1-a989-5eda32477dab tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:27.693562 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-5bfbf733-038a-4bb1-a989-5eda32477dab tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:27.922555 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-5bfbf733-038a-4bb1-a989-5eda32477dab tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e128ca83d6448c9ab1fe7dcc5467d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a090a68e336b4562aca524a95f550e04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:53:27.931102 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-5bfbf733-038a-4bb1-a989-5eda32477dab tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "GET /compute/v2.1/servers/358a3c59-ec18-40a6-b2a2-d7a37b46d08f" status: 200 len: 1364 microversion: 2.1 time: 0.253331 May 12 14:53:27.931658 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 331/657] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:53:27 2022] GET /compute/v2.1/servers/358a3c59-ec18-40a6-b2a2-d7a37b46d08f => generated 1364 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:53:28.059908 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [req-edd9e163-3da2-431f-a4d4-f3e0ab7d3c45 req-cf9df511-95ba-467a-96a5-77d0f1f4bfa8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "358a3c59-ec18-40a6-b2a2-d7a37b46d08f", "tag": "29d1dc1e-72a2-437b-94bf-fcacd84119d4"}]} {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:53:28.075662 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:53:28.075662 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: warnings.warn(msg) May 12 14:53:28.078906 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [req-edd9e163-3da2-431f-a4d4-f3e0ab7d3c45 req-cf9df511-95ba-467a-96a5-77d0f1f4bfa8 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:28.079572 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [req-edd9e163-3da2-431f-a4d4-f3e0ab7d3c45 req-cf9df511-95ba-467a-96a5-77d0f1f4bfa8 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:28.097750 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.compute.server_external_events [req-edd9e163-3da2-431f-a4d4-f3e0ab7d3c45 req-cf9df511-95ba-467a-96a5-77d0f1f4bfa8 service nova] Creating event network-changed:29d1dc1e-72a2-437b-94bf-fcacd84119d4 for instance 358a3c59-ec18-40a6-b2a2-d7a37b46d08f on hv-cinder-83118 May 12 14:53:28.106140 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [req-edd9e163-3da2-431f-a4d4-f3e0ab7d3c45 req-cf9df511-95ba-467a-96a5-77d0f1f4bfa8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055697 May 12 14:53:28.106140 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 327/658] 10.222.0.49 () {64 vars in 1317 bytes} [Thu May 12 14:53:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:53:28.545295 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-3e2336fc-8d1e-4d9d-b942-92296514d77a tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:28.554399 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-3e2336fc-8d1e-4d9d-b942-92296514d77a tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:53:28.555940 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-3e2336fc-8d1e-4d9d-b942-92296514d77a tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:28.556398 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-3e2336fc-8d1e-4d9d-b942-92296514d77a tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:28.557180 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-3e2336fc-8d1e-4d9d-b942-92296514d77a tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:28.557615 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-3e2336fc-8d1e-4d9d-b942-92296514d77a tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:28.631675 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-3e2336fc-8d1e-4d9d-b942-92296514d77a tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.090231 May 12 14:53:28.636041 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 332/659] 10.222.0.49 () {60 vars in 1342 bytes} [Thu May 12 14:53:28 2022] GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 14:53:28.948461 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-ba5237ae-c6e6-4332-b153-95e7d302ef0d tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:28.949070 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-ba5237ae-c6e6-4332-b153-95e7d302ef0d tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 358a3c59-ec18-40a6-b2a2-d7a37b46d08f] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:53:28.956404 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-ba5237ae-c6e6-4332-b153-95e7d302ef0d tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:28.956855 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-ba5237ae-c6e6-4332-b153-95e7d302ef0d tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:28.957609 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-ba5237ae-c6e6-4332-b153-95e7d302ef0d tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:28.958037 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-ba5237ae-c6e6-4332-b153-95e7d302ef0d tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:29.294293 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-e53a6928-c3f8-4bd6-b8e5-df4c063df942 tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-351696098", "imageRef": "a4587ab2-5f51-46a3-a023-0e6778ccaaa1", "flavorRef": "452"}} {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:53:29.364509 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.network.neutron [None req-e53a6928-c3f8-4bd6-b8e5-df4c063df942 tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] validate_networks() for None {{(pid=102213) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} May 12 14:53:29.433660 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-ba5237ae-c6e6-4332-b153-95e7d302ef0d tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e128ca83d6448c9ab1fe7dcc5467d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a090a68e336b4562aca524a95f550e04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:53:29.442894 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-ba5237ae-c6e6-4332-b153-95e7d302ef0d tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "GET /compute/v2.1/servers/358a3c59-ec18-40a6-b2a2-d7a37b46d08f" status: 200 len: 1364 microversion: 2.1 time: 0.498636 May 12 14:53:29.443477 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 328/660] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:53:28 2022] GET /compute/v2.1/servers/358a3c59-ec18-40a6-b2a2-d7a37b46d08f => generated 1364 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:53:29.621490 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.virt.hardware [None req-e53a6928-c3f8-4bd6-b8e5-df4c063df942 tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Flavor limits 0:0:0 {{(pid=102213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 14:53:29.622056 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.virt.hardware [None req-e53a6928-c3f8-4bd6-b8e5-df4c063df942 tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Image limits 0:0:0 {{(pid=102213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 14:53:29.622539 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.virt.hardware [None req-e53a6928-c3f8-4bd6-b8e5-df4c063df942 tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Flavor pref 0:0:0 {{(pid=102213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 14:53:29.622984 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.virt.hardware [None req-e53a6928-c3f8-4bd6-b8e5-df4c063df942 tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Image pref 0:0:0 {{(pid=102213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 14:53:29.623404 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.virt.hardware [None req-e53a6928-c3f8-4bd6-b8e5-df4c063df942 tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=102213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 14:53:29.632864 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e53a6928-c3f8-4bd6-b8e5-df4c063df942 tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:29.633308 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e53a6928-c3f8-4bd6-b8e5-df4c063df942 tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:29.634113 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e53a6928-c3f8-4bd6-b8e5-df4c063df942 tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:29.634550 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e53a6928-c3f8-4bd6-b8e5-df4c063df942 tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:29.643501 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-dcaf26dc-2d3b-40af-a9ef-a403a5c5ca30 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:29.644636 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-dcaf26dc-2d3b-40af-a9ef-a403a5c5ca30 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:53:29.654440 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-dcaf26dc-2d3b-40af-a9ef-a403a5c5ca30 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:29.654930 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-dcaf26dc-2d3b-40af-a9ef-a403a5c5ca30 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:29.655711 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-dcaf26dc-2d3b-40af-a9ef-a403a5c5ca30 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:29.656146 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-dcaf26dc-2d3b-40af-a9ef-a403a5c5ca30 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:29.656574 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.quota [None req-e53a6928-c3f8-4bd6-b8e5-df4c063df942 tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Getting quotas for project dbd2b6082f554c90b7b78f0a59634e80. Resources: {'cores', 'ram', 'instances'} {{(pid=102213) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 12 14:53:29.661767 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.quota [None req-e53a6928-c3f8-4bd6-b8e5-df4c063df942 tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Getting quotas for user 298bd0429941448eae2e143f8210b53c and project dbd2b6082f554c90b7b78f0a59634e80. Resources: {'cores', 'ram', 'instances'} {{(pid=102213) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 12 14:53:29.673127 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-e53a6928-c3f8-4bd6-b8e5-df4c063df942 tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Going to run 1 instances... {{(pid=102213) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 12 14:53:29.675474 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-e53a6928-c3f8-4bd6-b8e5-df4c063df942 tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] [instance: 70554c80-92d9-4b15-9510-b57a49d2c373] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a4587ab2-5f51-46a3-a023-0e6778ccaaa1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=102213) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} May 12 14:53:29.738197 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-dcaf26dc-2d3b-40af-a9ef-a403a5c5ca30 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.098947 May 12 14:53:29.742857 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 329/661] 10.222.0.49 () {60 vars in 1342 bytes} [Thu May 12 14:53:29 2022] GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 14:53:29.815143 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-e53a6928-c3f8-4bd6-b8e5-df4c063df942 tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.524486 May 12 14:53:29.816115 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 333/662] 10.222.0.49 () {60 vars in 1146 bytes} [Thu May 12 14:53:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 526 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 12 14:53:29.825757 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-64860bac-719d-4a30-a5c9-90204528955d tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:29.826400 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-64860bac-719d-4a30-a5c9-90204528955d tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] [instance: 70554c80-92d9-4b15-9510-b57a49d2c373] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:53:29.897149 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-64860bac-719d-4a30-a5c9-90204528955d tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298bd0429941448eae2e143f8210b53c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd2b6082f554c90b7b78f0a59634e80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:53:29.904872 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-64860bac-719d-4a30-a5c9-90204528955d tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] 10.222.0.49 "GET /compute/v2.1/servers/70554c80-92d9-4b15-9510-b57a49d2c373" status: 200 len: 1214 microversion: 2.1 time: 0.082816 May 12 14:53:29.905457 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 330/663] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:53:29 2022] GET /compute/v2.1/servers/70554c80-92d9-4b15-9510-b57a49d2c373 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:53:30.459509 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-d8eb4050-b792-4382-9ef2-528b9c09228a tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:30.460186 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-d8eb4050-b792-4382-9ef2-528b9c09228a tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 358a3c59-ec18-40a6-b2a2-d7a37b46d08f] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:53:30.467510 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-d8eb4050-b792-4382-9ef2-528b9c09228a tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:30.467957 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-d8eb4050-b792-4382-9ef2-528b9c09228a tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:30.468760 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-d8eb4050-b792-4382-9ef2-528b9c09228a tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:30.469195 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-d8eb4050-b792-4382-9ef2-528b9c09228a tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:30.668197 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-d8eb4050-b792-4382-9ef2-528b9c09228a tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e128ca83d6448c9ab1fe7dcc5467d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a090a68e336b4562aca524a95f550e04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:53:30.677202 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-d8eb4050-b792-4382-9ef2-528b9c09228a tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "GET /compute/v2.1/servers/358a3c59-ec18-40a6-b2a2-d7a37b46d08f" status: 200 len: 1364 microversion: 2.1 time: 0.222102 May 12 14:53:30.677785 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 334/664] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:53:30 2022] GET /compute/v2.1/servers/358a3c59-ec18-40a6-b2a2-d7a37b46d08f => generated 1364 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:53:30.750530 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-80ef783f-5143-4b69-a8e3-1530e5d6a4fd tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:30.751897 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-80ef783f-5143-4b69-a8e3-1530e5d6a4fd tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:53:30.760730 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-80ef783f-5143-4b69-a8e3-1530e5d6a4fd tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:30.761263 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-80ef783f-5143-4b69-a8e3-1530e5d6a4fd tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:30.762027 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-80ef783f-5143-4b69-a8e3-1530e5d6a4fd tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:30.762472 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-80ef783f-5143-4b69-a8e3-1530e5d6a4fd tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:30.838852 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-80ef783f-5143-4b69-a8e3-1530e5d6a4fd tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.092209 May 12 14:53:30.839613 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 331/665] 10.222.0.49 () {60 vars in 1342 bytes} [Thu May 12 14:53:30 2022] GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 14:53:30.925576 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-6fd7f748-106c-4407-b12b-7dffd490a18d tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:30.926699 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-6fd7f748-106c-4407-b12b-7dffd490a18d tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] [instance: 70554c80-92d9-4b15-9510-b57a49d2c373] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:53:30.995171 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-6fd7f748-106c-4407-b12b-7dffd490a18d tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298bd0429941448eae2e143f8210b53c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd2b6082f554c90b7b78f0a59634e80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:53:31.005539 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-6fd7f748-106c-4407-b12b-7dffd490a18d tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] 10.222.0.49 "GET /compute/v2.1/servers/70554c80-92d9-4b15-9510-b57a49d2c373" status: 200 len: 1214 microversion: 2.1 time: 0.080877 May 12 14:53:31.005539 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 335/666] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:53:30 2022] GET /compute/v2.1/servers/70554c80-92d9-4b15-9510-b57a49d2c373 => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:53:31.693948 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-ba0e7ba5-8c76-4e89-b967-09743ba6ac49 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:31.694474 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-ba0e7ba5-8c76-4e89-b967-09743ba6ac49 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 358a3c59-ec18-40a6-b2a2-d7a37b46d08f] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:53:31.702200 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-ba0e7ba5-8c76-4e89-b967-09743ba6ac49 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:31.702650 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-ba0e7ba5-8c76-4e89-b967-09743ba6ac49 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:31.703471 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-ba0e7ba5-8c76-4e89-b967-09743ba6ac49 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:31.703905 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-ba0e7ba5-8c76-4e89-b967-09743ba6ac49 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:31.851031 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-3c6c0040-8e5f-4714-9fb0-dcae79050cfc tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:31.853368 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-3c6c0040-8e5f-4714-9fb0-dcae79050cfc tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:53:31.862151 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-3c6c0040-8e5f-4714-9fb0-dcae79050cfc tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:31.862639 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-3c6c0040-8e5f-4714-9fb0-dcae79050cfc tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:31.864374 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-3c6c0040-8e5f-4714-9fb0-dcae79050cfc tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:31.864978 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-3c6c0040-8e5f-4714-9fb0-dcae79050cfc tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:31.925186 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-ba0e7ba5-8c76-4e89-b967-09743ba6ac49 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e128ca83d6448c9ab1fe7dcc5467d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a090a68e336b4562aca524a95f550e04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:53:31.938730 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-ba0e7ba5-8c76-4e89-b967-09743ba6ac49 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "GET /compute/v2.1/servers/358a3c59-ec18-40a6-b2a2-d7a37b46d08f" status: 200 len: 1364 microversion: 2.1 time: 0.248566 May 12 14:53:31.939410 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 332/667] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:53:31 2022] GET /compute/v2.1/servers/358a3c59-ec18-40a6-b2a2-d7a37b46d08f => generated 1364 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:53:31.942880 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-3c6c0040-8e5f-4714-9fb0-dcae79050cfc tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.095523 May 12 14:53:31.947278 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 336/668] 10.222.0.49 () {60 vars in 1342 bytes} [Thu May 12 14:53:31 2022] GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 12 14:53:32.019916 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-cda97f41-4859-4007-b8f6-0bf111e9df3a tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:32.020866 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-cda97f41-4859-4007-b8f6-0bf111e9df3a tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] [instance: 70554c80-92d9-4b15-9510-b57a49d2c373] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:53:32.036692 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-cda97f41-4859-4007-b8f6-0bf111e9df3a tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:32.037145 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-cda97f41-4859-4007-b8f6-0bf111e9df3a tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:32.037930 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-cda97f41-4859-4007-b8f6-0bf111e9df3a tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:32.038369 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-cda97f41-4859-4007-b8f6-0bf111e9df3a tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:32.153970 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-cda97f41-4859-4007-b8f6-0bf111e9df3a tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298bd0429941448eae2e143f8210b53c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd2b6082f554c90b7b78f0a59634e80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:53:32.164260 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-cda97f41-4859-4007-b8f6-0bf111e9df3a tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] 10.222.0.49 "GET /compute/v2.1/servers/70554c80-92d9-4b15-9510-b57a49d2c373" status: 200 len: 1266 microversion: 2.1 time: 0.147894 May 12 14:53:32.173859 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 333/669] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:53:32 2022] GET /compute/v2.1/servers/70554c80-92d9-4b15-9510-b57a49d2c373 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:53:32.967313 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-4a5261a8-8448-473f-8263-3b3069350f92 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:32.978570 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-4a5261a8-8448-473f-8263-3b3069350f92 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 358a3c59-ec18-40a6-b2a2-d7a37b46d08f] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:53:32.986016 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-3d4b01bb-a03f-4862-8a76-6e688c2b3982 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:32.986016 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-3d4b01bb-a03f-4862-8a76-6e688c2b3982 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:53:33.002668 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-4a5261a8-8448-473f-8263-3b3069350f92 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:33.010221 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-3d4b01bb-a03f-4862-8a76-6e688c2b3982 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:33.010671 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-3d4b01bb-a03f-4862-8a76-6e688c2b3982 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:33.011494 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-3d4b01bb-a03f-4862-8a76-6e688c2b3982 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:33.011917 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-3d4b01bb-a03f-4862-8a76-6e688c2b3982 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:33.012241 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-4a5261a8-8448-473f-8263-3b3069350f92 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:33.013450 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-4a5261a8-8448-473f-8263-3b3069350f92 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:33.016099 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-4a5261a8-8448-473f-8263-3b3069350f92 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:33.136925 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-3d4b01bb-a03f-4862-8a76-6e688c2b3982 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.187211 May 12 14:53:33.138012 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 337/670] 10.222.0.49 () {60 vars in 1342 bytes} [Thu May 12 14:53:32 2022] GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9/os-volume_attachments => generated 197 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 12 14:53:33.181709 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-16303989-ca2c-4193-a724-814350294afd tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:33.182328 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-16303989-ca2c-4193-a724-814350294afd tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] [instance: 70554c80-92d9-4b15-9510-b57a49d2c373] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:53:33.194702 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-16303989-ca2c-4193-a724-814350294afd tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:33.195931 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-16303989-ca2c-4193-a724-814350294afd tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:33.197088 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-16303989-ca2c-4193-a724-814350294afd tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:33.197638 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-16303989-ca2c-4193-a724-814350294afd tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:33.337341 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-16303989-ca2c-4193-a724-814350294afd tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298bd0429941448eae2e143f8210b53c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd2b6082f554c90b7b78f0a59634e80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:53:33.345684 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-16303989-ca2c-4193-a724-814350294afd tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] 10.222.0.49 "GET /compute/v2.1/servers/70554c80-92d9-4b15-9510-b57a49d2c373" status: 200 len: 1272 microversion: 2.1 time: 0.167967 May 12 14:53:33.346261 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 338/671] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:53:33 2022] GET /compute/v2.1/servers/70554c80-92d9-4b15-9510-b57a49d2c373 => generated 1272 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:53:33.461954 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-4a5261a8-8448-473f-8263-3b3069350f92 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e128ca83d6448c9ab1fe7dcc5467d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a090a68e336b4562aca524a95f550e04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:53:33.470365 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-4a5261a8-8448-473f-8263-3b3069350f92 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "GET /compute/v2.1/servers/358a3c59-ec18-40a6-b2a2-d7a37b46d08f" status: 200 len: 1364 microversion: 2.1 time: 0.516634 May 12 14:53:33.470949 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 334/672] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:53:32 2022] GET /compute/v2.1/servers/358a3c59-ec18-40a6-b2a2-d7a37b46d08f => generated 1364 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:53:34.149115 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-d302278c-84c2-4332-ba03-4c7d1e0483b7 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:34.159124 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-d302278c-84c2-4332-ba03-4c7d1e0483b7 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:53:34.170392 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-d302278c-84c2-4332-ba03-4c7d1e0483b7 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:34.171610 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-d302278c-84c2-4332-ba03-4c7d1e0483b7 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:34.172815 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-d302278c-84c2-4332-ba03-4c7d1e0483b7 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:34.173446 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-d302278c-84c2-4332-ba03-4c7d1e0483b7 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:34.282881 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-d302278c-84c2-4332-ba03-4c7d1e0483b7 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.138653 May 12 14:53:34.284172 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 339/673] 10.222.0.49 () {60 vars in 1342 bytes} [Thu May 12 14:53:34 2022] GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9/os-volume_attachments => generated 197 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 14:53:34.354983 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-ead5edcd-362d-4b4f-8adb-e10782b8ce5f tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d9da0915-9ff9-4e36-ad32-c97a7a5dea8c"}} {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:53:34.356075 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-ead5edcd-362d-4b4f-8adb-e10782b8ce5f tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 6f7de537-3c2b-4b45-a0da-e5b9ab7c169a] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:53:34.364728 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-ead5edcd-362d-4b4f-8adb-e10782b8ce5f tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:34.365420 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-ead5edcd-362d-4b4f-8adb-e10782b8ce5f tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:34.366400 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-ead5edcd-362d-4b4f-8adb-e10782b8ce5f tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:34.368301 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-43774334-7856-4167-83d1-764ce671a5ea tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:34.368928 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-43774334-7856-4167-83d1-764ce671a5ea tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] [instance: 70554c80-92d9-4b15-9510-b57a49d2c373] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:53:34.369765 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-ead5edcd-362d-4b4f-8adb-e10782b8ce5f tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:34.379372 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-43774334-7856-4167-83d1-764ce671a5ea tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:34.379819 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-43774334-7856-4167-83d1-764ce671a5ea tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:34.381201 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-43774334-7856-4167-83d1-764ce671a5ea tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:34.381916 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-43774334-7856-4167-83d1-764ce671a5ea tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:34.588251 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.wsgi [None req-ead5edcd-362d-4b4f-8adb-e10782b8ce5f tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] HTTP exception thrown: Invalid volume: volume d9da0915-9ff9-4e36-ad32-c97a7a5dea8c is already attached to instances: 6f7de537-3c2b-4b45-a0da-e5b9ab7c169a May 12 14:53:34.588782 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-ead5edcd-362d-4b4f-8adb-e10782b8ce5f tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Returning 400 to user: Invalid volume: volume d9da0915-9ff9-4e36-ad32-c97a7a5dea8c is already attached to instances: 6f7de537-3c2b-4b45-a0da-e5b9ab7c169a {{(pid=102212) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 12 14:53:34.589723 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-ead5edcd-362d-4b4f-8adb-e10782b8ce5f tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "POST /compute/v2.1/servers/6f7de537-3c2b-4b45-a0da-e5b9ab7c169a/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.238767 May 12 14:53:34.593421 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 335/674] 10.222.0.49 () {60 vars in 1322 bytes} [Thu May 12 14:53:34 2022] POST /compute/v2.1/servers/6f7de537-3c2b-4b45-a0da-e5b9ab7c169a/os-volume_attachments => generated 174 bytes in 240 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 12 14:53:34.595881 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-4260674f-59f9-4d97-b16c-ff1058b825cf tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:34.597521 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-4260674f-59f9-4d97-b16c-ff1058b825cf tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 358a3c59-ec18-40a6-b2a2-d7a37b46d08f] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:53:34.606562 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-4260674f-59f9-4d97-b16c-ff1058b825cf tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:34.607071 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-4260674f-59f9-4d97-b16c-ff1058b825cf tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:34.607856 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-4260674f-59f9-4d97-b16c-ff1058b825cf tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:34.608308 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-4260674f-59f9-4d97-b16c-ff1058b825cf tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:34.731026 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-43774334-7856-4167-83d1-764ce671a5ea tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298bd0429941448eae2e143f8210b53c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd2b6082f554c90b7b78f0a59634e80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:53:34.736202 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-43774334-7856-4167-83d1-764ce671a5ea tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] 10.222.0.49 "GET /compute/v2.1/servers/70554c80-92d9-4b15-9510-b57a49d2c373" status: 200 len: 1314 microversion: 2.1 time: 0.372628 May 12 14:53:34.736533 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 340/675] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:53:34 2022] GET /compute/v2.1/servers/70554c80-92d9-4b15-9510-b57a49d2c373 => generated 1314 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:53:34.749101 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-dbbb9c8e-4006-4dc4-b45a-f2e206519a2d tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:34.749907 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-dbbb9c8e-4006-4dc4-b45a-f2e206519a2d tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 6f7de537-3c2b-4b45-a0da-e5b9ab7c169a] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:53:34.758280 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-dbbb9c8e-4006-4dc4-b45a-f2e206519a2d tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:34.758996 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-dbbb9c8e-4006-4dc4-b45a-f2e206519a2d tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:34.760877 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-dbbb9c8e-4006-4dc4-b45a-f2e206519a2d tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:34.761487 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-dbbb9c8e-4006-4dc4-b45a-f2e206519a2d tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:34.926318 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.objects.instance [None req-dbbb9c8e-4006-4dc4-b45a-f2e206519a2d tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lazy-loading 'services' on Instance uuid 6f7de537-3c2b-4b45-a0da-e5b9ab7c169a {{(pid=102213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 12 14:53:35.062337 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-4260674f-59f9-4d97-b16c-ff1058b825cf tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e128ca83d6448c9ab1fe7dcc5467d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a090a68e336b4562aca524a95f550e04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:53:35.071493 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-4260674f-59f9-4d97-b16c-ff1058b825cf tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "GET /compute/v2.1/servers/358a3c59-ec18-40a6-b2a2-d7a37b46d08f" status: 200 len: 1364 microversion: 2.1 time: 0.479760 May 12 14:53:35.072190 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 336/676] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:53:34 2022] GET /compute/v2.1/servers/358a3c59-ec18-40a6-b2a2-d7a37b46d08f => generated 1364 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:53:35.077181 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [req-9d845f60-d841-498f-a237-3f2255f4b587 req-397f23b7-6781-48ac-9067-345143279ca1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "358a3c59-ec18-40a6-b2a2-d7a37b46d08f", "name": "network-vif-plugged", "status": "completed", "tag": "29d1dc1e-72a2-437b-94bf-fcacd84119d4"}]} {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:53:35.078679 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:53:35.078679 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: warnings.warn(msg) May 12 14:53:35.088302 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [req-9d845f60-d841-498f-a237-3f2255f4b587 req-397f23b7-6781-48ac-9067-345143279ca1 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:35.088302 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [req-9d845f60-d841-498f-a237-3f2255f4b587 req-397f23b7-6781-48ac-9067-345143279ca1 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:35.105222 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.compute.server_external_events [req-9d845f60-d841-498f-a237-3f2255f4b587 req-397f23b7-6781-48ac-9067-345143279ca1 service nova] Creating event network-vif-plugged:29d1dc1e-72a2-437b-94bf-fcacd84119d4 for instance 358a3c59-ec18-40a6-b2a2-d7a37b46d08f on hv-cinder-83118 May 12 14:53:35.110128 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [req-9d845f60-d841-498f-a237-3f2255f4b587 req-397f23b7-6781-48ac-9067-345143279ca1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036266 May 12 14:53:35.110744 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 337/677] 10.222.0.49 () {64 vars in 1317 bytes} [Thu May 12 14:53:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:53:35.285991 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-dbbb9c8e-4006-4dc4-b45a-f2e206519a2d tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "DELETE /compute/v2.1/servers/6f7de537-3c2b-4b45-a0da-e5b9ab7c169a/os-volume_attachments/d9da0915-9ff9-4e36-ad32-c97a7a5dea8c" status: 202 len: 0 microversion: 2.1 time: 0.547921 May 12 14:53:35.291142 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 341/678] 10.222.0.49 () {58 vars in 1415 bytes} [Thu May 12 14:53:34 2022] DELETE /compute/v2.1/servers/6f7de537-3c2b-4b45-a0da-e5b9ab7c169a/os-volume_attachments/d9da0915-9ff9-4e36-ad32-c97a7a5dea8c => generated 0 bytes in 550 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 14:53:35.296622 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-0dc8ad8d-ae04-4c21-a2e4-633bab854586 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:35.297610 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-bbc79515-ad8c-465a-b299-60fa5cc576f5 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:35.298132 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-0dc8ad8d-ae04-4c21-a2e4-633bab854586 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:53:35.298668 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-bbc79515-ad8c-465a-b299-60fa5cc576f5 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 6f7de537-3c2b-4b45-a0da-e5b9ab7c169a] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:53:35.307165 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-bbc79515-ad8c-465a-b299-60fa5cc576f5 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:35.307613 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-bbc79515-ad8c-465a-b299-60fa5cc576f5 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:35.308387 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-bbc79515-ad8c-465a-b299-60fa5cc576f5 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:35.308823 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-bbc79515-ad8c-465a-b299-60fa5cc576f5 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:35.314673 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-0dc8ad8d-ae04-4c21-a2e4-633bab854586 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:35.315018 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-0dc8ad8d-ae04-4c21-a2e4-633bab854586 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:35.315804 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-0dc8ad8d-ae04-4c21-a2e4-633bab854586 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:35.316215 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-0dc8ad8d-ae04-4c21-a2e4-633bab854586 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:35.392947 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-bbc79515-ad8c-465a-b299-60fa5cc576f5 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/6f7de537-3c2b-4b45-a0da-e5b9ab7c169a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.099485 May 12 14:53:35.393517 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 342/679] 10.222.0.49 () {58 vars in 1301 bytes} [Thu May 12 14:53:35 2022] GET /compute/v2.1/servers/6f7de537-3c2b-4b45-a0da-e5b9ab7c169a/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:53:35.400539 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-0dc8ad8d-ae04-4c21-a2e4-633bab854586 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.109322 May 12 14:53:35.401266 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 338/680] 10.222.0.49 () {60 vars in 1342 bytes} [Thu May 12 14:53:35 2022] GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9/os-volume_attachments => generated 25 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:53:35.493136 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-26893488-d72b-4b58-aa86-124c4684de21 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:35.493689 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-26893488-d72b-4b58-aa86-124c4684de21 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:53:35.501513 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-26893488-d72b-4b58-aa86-124c4684de21 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:35.501999 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-26893488-d72b-4b58-aa86-124c4684de21 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:35.502898 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-26893488-d72b-4b58-aa86-124c4684de21 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:35.503339 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-26893488-d72b-4b58-aa86-124c4684de21 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:35.586250 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-26893488-d72b-4b58-aa86-124c4684de21 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9] Going to try to terminate instance {{(pid=102213) delete /opt/stack/nova/nova/compute/api.py:2562}} May 12 14:53:35.752988 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-7c5581e2-ee63-4ded-b671-cebf17f42b82 tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:35.754719 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-7c5581e2-ee63-4ded-b671-cebf17f42b82 tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] [instance: 70554c80-92d9-4b15-9510-b57a49d2c373] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:53:35.762405 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-7c5581e2-ee63-4ded-b671-cebf17f42b82 tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:35.763233 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-7c5581e2-ee63-4ded-b671-cebf17f42b82 tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:35.764377 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-7c5581e2-ee63-4ded-b671-cebf17f42b82 tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:35.765034 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-7c5581e2-ee63-4ded-b671-cebf17f42b82 tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:35.961747 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-26893488-d72b-4b58-aa86-124c4684de21 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "DELETE /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9" status: 204 len: 0 microversion: 2.20 time: 0.473347 May 12 14:53:35.962346 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 343/681] 10.222.0.49 () {60 vars in 1279 bytes} [Thu May 12 14:53:35 2022] DELETE /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 12 14:53:35.970395 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-89b56511-72bf-446e-af1f-1ce145a4c2a6 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:35.971166 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-89b56511-72bf-446e-af1f-1ce145a4c2a6 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:53:35.978417 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-89b56511-72bf-446e-af1f-1ce145a4c2a6 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:35.978899 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-89b56511-72bf-446e-af1f-1ce145a4c2a6 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:35.979644 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-89b56511-72bf-446e-af1f-1ce145a4c2a6 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:35.980066 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-89b56511-72bf-446e-af1f-1ce145a4c2a6 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:36.241645 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-89b56511-72bf-446e-af1f-1ce145a4c2a6 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:53:36.253511 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-89b56511-72bf-446e-af1f-1ce145a4c2a6 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:53:36.255983 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-89b56511-72bf-446e-af1f-1ce145a4c2a6 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:53:36.256246 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-89b56511-72bf-446e-af1f-1ce145a4c2a6 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9" status: 200 len: 1723 microversion: 2.20 time: 0.289669 May 12 14:53:36.256902 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 344/682] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:53:35 2022] GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9 => generated 1723 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 14:53:36.275639 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-4cf408e5-a624-4fc5-91ac-26de95850b24 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:36.276543 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-4cf408e5-a624-4fc5-91ac-26de95850b24 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 358a3c59-ec18-40a6-b2a2-d7a37b46d08f] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:53:36.285608 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-4cf408e5-a624-4fc5-91ac-26de95850b24 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:36.290351 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-4cf408e5-a624-4fc5-91ac-26de95850b24 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:36.290351 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-4cf408e5-a624-4fc5-91ac-26de95850b24 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:36.290351 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-4cf408e5-a624-4fc5-91ac-26de95850b24 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:36.336448 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-7c5581e2-ee63-4ded-b671-cebf17f42b82 tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298bd0429941448eae2e143f8210b53c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd2b6082f554c90b7b78f0a59634e80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:53:36.345759 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-7c5581e2-ee63-4ded-b671-cebf17f42b82 tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] 10.222.0.49 "GET /compute/v2.1/servers/70554c80-92d9-4b15-9510-b57a49d2c373" status: 200 len: 1314 microversion: 2.1 time: 0.596630 May 12 14:53:36.355851 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 339/683] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:53:35 2022] GET /compute/v2.1/servers/70554c80-92d9-4b15-9510-b57a49d2c373 => generated 1314 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:53:36.362737 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [req-8a121507-dff0-4e6d-abdd-c1aff28fbb8a req-a91595a0-e279-4787-a82c-b7cd7c727079 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70554c80-92d9-4b15-9510-b57a49d2c373", "tag": "3138fe9b-4e8e-48d7-aeee-07d15301d4c1"}]} {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:53:36.366061 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:53:36.366061 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: warnings.warn(msg) May 12 14:53:36.384984 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [req-8a121507-dff0-4e6d-abdd-c1aff28fbb8a req-a91595a0-e279-4787-a82c-b7cd7c727079 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:36.385439 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [req-8a121507-dff0-4e6d-abdd-c1aff28fbb8a req-a91595a0-e279-4787-a82c-b7cd7c727079 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:36.404835 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.compute.server_external_events [req-8a121507-dff0-4e6d-abdd-c1aff28fbb8a req-a91595a0-e279-4787-a82c-b7cd7c727079 service nova] Creating event network-changed:3138fe9b-4e8e-48d7-aeee-07d15301d4c1 for instance 70554c80-92d9-4b15-9510-b57a49d2c373 on hv-cinder-83118 May 12 14:53:36.413548 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [req-8a121507-dff0-4e6d-abdd-c1aff28fbb8a req-a91595a0-e279-4787-a82c-b7cd7c727079 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054753 May 12 14:53:36.414658 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 340/684] 10.222.0.49 () {64 vars in 1317 bytes} [Thu May 12 14:53:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:53:36.422784 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-4587548e-09f4-4816-92d7-233a276eddad tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:36.424211 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-4587548e-09f4-4816-92d7-233a276eddad tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 6f7de537-3c2b-4b45-a0da-e5b9ab7c169a] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:53:36.433380 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-4587548e-09f4-4816-92d7-233a276eddad tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:36.433837 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-4587548e-09f4-4816-92d7-233a276eddad tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:36.434647 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-4587548e-09f4-4816-92d7-233a276eddad tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:36.435317 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-4587548e-09f4-4816-92d7-233a276eddad tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:36.511585 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-4587548e-09f4-4816-92d7-233a276eddad tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/6f7de537-3c2b-4b45-a0da-e5b9ab7c169a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095523 May 12 14:53:36.512443 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 341/685] 10.222.0.49 () {58 vars in 1301 bytes} [Thu May 12 14:53:36 2022] GET /compute/v2.1/servers/6f7de537-3c2b-4b45-a0da-e5b9ab7c169a/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:53:36.539759 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-4cf408e5-a624-4fc5-91ac-26de95850b24 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e128ca83d6448c9ab1fe7dcc5467d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a090a68e336b4562aca524a95f550e04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:53:36.548095 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-4cf408e5-a624-4fc5-91ac-26de95850b24 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "GET /compute/v2.1/servers/358a3c59-ec18-40a6-b2a2-d7a37b46d08f" status: 200 len: 1364 microversion: 2.1 time: 0.290003 May 12 14:53:36.548960 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 345/686] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:53:36 2022] GET /compute/v2.1/servers/358a3c59-ec18-40a6-b2a2-d7a37b46d08f => generated 1364 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:53:37.275248 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-fc9de1a3-8a8f-4bd6-8767-2660f1155aff tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:37.275855 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-fc9de1a3-8a8f-4bd6-8767-2660f1155aff tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:53:37.283379 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-fc9de1a3-8a8f-4bd6-8767-2660f1155aff tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:37.283718 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-fc9de1a3-8a8f-4bd6-8767-2660f1155aff tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:37.284658 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-fc9de1a3-8a8f-4bd6-8767-2660f1155aff tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:37.285081 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-fc9de1a3-8a8f-4bd6-8767-2660f1155aff tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:37.366531 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-aaddeb30-11f5-494b-95aa-d9f6cbb0522a tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:37.367368 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-aaddeb30-11f5-494b-95aa-d9f6cbb0522a tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] [instance: 70554c80-92d9-4b15-9510-b57a49d2c373] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:53:37.375054 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-aaddeb30-11f5-494b-95aa-d9f6cbb0522a tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:37.375504 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-aaddeb30-11f5-494b-95aa-d9f6cbb0522a tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:37.376280 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-aaddeb30-11f5-494b-95aa-d9f6cbb0522a tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:37.376901 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-aaddeb30-11f5-494b-95aa-d9f6cbb0522a tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:37.597265 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-aaddeb30-11f5-494b-95aa-d9f6cbb0522a tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298bd0429941448eae2e143f8210b53c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd2b6082f554c90b7b78f0a59634e80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:53:37.608838 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-aaddeb30-11f5-494b-95aa-d9f6cbb0522a tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] 10.222.0.49 "GET /compute/v2.1/servers/70554c80-92d9-4b15-9510-b57a49d2c373" status: 200 len: 1314 microversion: 2.1 time: 0.248584 May 12 14:53:37.609435 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 346/687] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:53:37 2022] GET /compute/v2.1/servers/70554c80-92d9-4b15-9510-b57a49d2c373 => generated 1314 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:53:37.613932 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-a11ad392-2454-48f5-a0f7-832393914d6d tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:37.614932 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-a11ad392-2454-48f5-a0f7-832393914d6d tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 6f7de537-3c2b-4b45-a0da-e5b9ab7c169a] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:53:37.622438 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-a11ad392-2454-48f5-a0f7-832393914d6d tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:37.622929 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-a11ad392-2454-48f5-a0f7-832393914d6d tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:37.623705 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-a11ad392-2454-48f5-a0f7-832393914d6d tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:37.624147 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-a11ad392-2454-48f5-a0f7-832393914d6d tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:37.682127 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-fc9de1a3-8a8f-4bd6-8767-2660f1155aff tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:53:37.689484 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-a11ad392-2454-48f5-a0f7-832393914d6d tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/6f7de537-3c2b-4b45-a0da-e5b9ab7c169a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.078994 May 12 14:53:37.690072 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 347/688] 10.222.0.49 () {58 vars in 1301 bytes} [Thu May 12 14:53:37 2022] GET /compute/v2.1/servers/6f7de537-3c2b-4b45-a0da-e5b9ab7c169a/os-volume_attachments => generated 25 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 12 14:53:37.691322 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-fc9de1a3-8a8f-4bd6-8767-2660f1155aff tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:53:37.693218 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-fc9de1a3-8a8f-4bd6-8767-2660f1155aff tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:53:37.694568 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-fc9de1a3-8a8f-4bd6-8767-2660f1155aff tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9" status: 200 len: 1723 microversion: 2.20 time: 0.423175 May 12 14:53:37.695550 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 342/689] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:53:37 2022] GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9 => generated 1723 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:53:37.704160 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-1fcde8ec-2617-45c2-abb2-3f4cc0bdfdd6 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:37.704989 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-1fcde8ec-2617-45c2-abb2-3f4cc0bdfdd6 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 358a3c59-ec18-40a6-b2a2-d7a37b46d08f] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:53:37.713098 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-1fcde8ec-2617-45c2-abb2-3f4cc0bdfdd6 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:37.713813 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-1fcde8ec-2617-45c2-abb2-3f4cc0bdfdd6 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:37.714643 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-1fcde8ec-2617-45c2-abb2-3f4cc0bdfdd6 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:37.715162 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-1fcde8ec-2617-45c2-abb2-3f4cc0bdfdd6 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:37.788505 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-bdcebe31-2848-46b1-ba77-d4f1e3c1df9a tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:37.789005 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-bdcebe31-2848-46b1-ba77-d4f1e3c1df9a tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 6f7de537-3c2b-4b45-a0da-e5b9ab7c169a] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:53:37.796462 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-bdcebe31-2848-46b1-ba77-d4f1e3c1df9a tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:37.796845 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-bdcebe31-2848-46b1-ba77-d4f1e3c1df9a tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:37.797631 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-bdcebe31-2848-46b1-ba77-d4f1e3c1df9a tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:37.798055 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-bdcebe31-2848-46b1-ba77-d4f1e3c1df9a tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:37.863017 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-bdcebe31-2848-46b1-ba77-d4f1e3c1df9a tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 6f7de537-3c2b-4b45-a0da-e5b9ab7c169a] Going to try to terminate instance {{(pid=102212) delete /opt/stack/nova/nova/compute/api.py:2562}} May 12 14:53:37.925366 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-1fcde8ec-2617-45c2-abb2-3f4cc0bdfdd6 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e128ca83d6448c9ab1fe7dcc5467d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a090a68e336b4562aca524a95f550e04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:53:37.933847 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-1fcde8ec-2617-45c2-abb2-3f4cc0bdfdd6 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "GET /compute/v2.1/servers/358a3c59-ec18-40a6-b2a2-d7a37b46d08f" status: 200 len: 1550 microversion: 2.1 time: 0.242008 May 12 14:53:37.934851 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 348/690] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:53:37 2022] GET /compute/v2.1/servers/358a3c59-ec18-40a6-b2a2-d7a37b46d08f => generated 1550 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:53:37.950721 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-6de9ad64-3a79-4aca-9ce9-2568055b1cf9 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:37.953188 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-6de9ad64-3a79-4aca-9ce9-2568055b1cf9 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 358a3c59-ec18-40a6-b2a2-d7a37b46d08f] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:53:37.959079 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-6de9ad64-3a79-4aca-9ce9-2568055b1cf9 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:37.959534 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-6de9ad64-3a79-4aca-9ce9-2568055b1cf9 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:37.960316 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-6de9ad64-3a79-4aca-9ce9-2568055b1cf9 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:37.960749 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-6de9ad64-3a79-4aca-9ce9-2568055b1cf9 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:38.113130 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-6de9ad64-3a79-4aca-9ce9-2568055b1cf9 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "GET /compute/v2.1/servers/358a3c59-ec18-40a6-b2a2-d7a37b46d08f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.166213 May 12 14:53:38.113742 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 349/691] 10.222.0.49 () {58 vars in 1274 bytes} [Thu May 12 14:53:37 2022] GET /compute/v2.1/servers/358a3c59-ec18-40a6-b2a2-d7a37b46d08f/os-interface => generated 285 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 14:53:38.395739 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-bdcebe31-2848-46b1-ba77-d4f1e3c1df9a tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "DELETE /compute/v2.1/servers/6f7de537-3c2b-4b45-a0da-e5b9ab7c169a" status: 204 len: 0 microversion: 2.1 time: 0.610434 May 12 14:53:38.396424 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 343/692] 10.222.0.49 () {58 vars in 1238 bytes} [Thu May 12 14:53:37 2022] DELETE /compute/v2.1/servers/6f7de537-3c2b-4b45-a0da-e5b9ab7c169a => generated 0 bytes in 612 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 12 14:53:38.404303 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-67440023-d782-4a06-94d6-e59ba0e252b3 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:38.404912 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-67440023-d782-4a06-94d6-e59ba0e252b3 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 6f7de537-3c2b-4b45-a0da-e5b9ab7c169a] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:53:38.418422 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-67440023-d782-4a06-94d6-e59ba0e252b3 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:38.426317 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-67440023-d782-4a06-94d6-e59ba0e252b3 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:38.426317 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-67440023-d782-4a06-94d6-e59ba0e252b3 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:38.426317 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-67440023-d782-4a06-94d6-e59ba0e252b3 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:38.625943 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-766e7a53-daa0-4ac5-9860-9f7abcea766a tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:38.626643 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-766e7a53-daa0-4ac5-9860-9f7abcea766a tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] [instance: 70554c80-92d9-4b15-9510-b57a49d2c373] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:53:38.633907 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-766e7a53-daa0-4ac5-9860-9f7abcea766a tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:38.634352 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-766e7a53-daa0-4ac5-9860-9f7abcea766a tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:38.635218 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-766e7a53-daa0-4ac5-9860-9f7abcea766a tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:38.635649 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-766e7a53-daa0-4ac5-9860-9f7abcea766a tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:38.799260 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-67440023-d782-4a06-94d6-e59ba0e252b3 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a641a08648b454780081ecc2e291066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a8451272cc41ebaf1598ed940bf09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:53:38.799260 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-67440023-d782-4a06-94d6-e59ba0e252b3 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/6f7de537-3c2b-4b45-a0da-e5b9ab7c169a" status: 200 len: 1682 microversion: 2.1 time: 0.384945 May 12 14:53:38.799260 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 350/693] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:53:38 2022] GET /compute/v2.1/servers/6f7de537-3c2b-4b45-a0da-e5b9ab7c169a => generated 1682 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:53:38.799791 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-5563ed08-1af3-48f2-8c56-cd98c0dc551a tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:38.800138 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-5563ed08-1af3-48f2-8c56-cd98c0dc551a tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:53:38.807233 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-5563ed08-1af3-48f2-8c56-cd98c0dc551a tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:38.807677 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-5563ed08-1af3-48f2-8c56-cd98c0dc551a tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:38.808442 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-5563ed08-1af3-48f2-8c56-cd98c0dc551a tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:38.808871 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-5563ed08-1af3-48f2-8c56-cd98c0dc551a tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:39.076303 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-5563ed08-1af3-48f2-8c56-cd98c0dc551a tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:53:39.085066 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-5563ed08-1af3-48f2-8c56-cd98c0dc551a tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:53:39.086573 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-5563ed08-1af3-48f2-8c56-cd98c0dc551a tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:53:39.087788 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-5563ed08-1af3-48f2-8c56-cd98c0dc551a tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9" status: 200 len: 1723 microversion: 2.20 time: 0.291740 May 12 14:53:39.088353 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 351/694] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:53:38 2022] GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9 => generated 1723 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:53:39.179646 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-766e7a53-daa0-4ac5-9860-9f7abcea766a tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298bd0429941448eae2e143f8210b53c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd2b6082f554c90b7b78f0a59634e80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:53:39.199288 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-766e7a53-daa0-4ac5-9860-9f7abcea766a tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] 10.222.0.49 "GET /compute/v2.1/servers/70554c80-92d9-4b15-9510-b57a49d2c373" status: 200 len: 1314 microversion: 2.1 time: 0.577178 May 12 14:53:39.203203 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 344/695] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:53:38 2022] GET /compute/v2.1/servers/70554c80-92d9-4b15-9510-b57a49d2c373 => generated 1314 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:53:39.802921 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-221fabf6-161b-4f89-bd6a-551b7288d224 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:39.803708 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-221fabf6-161b-4f89-bd6a-551b7288d224 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 6f7de537-3c2b-4b45-a0da-e5b9ab7c169a] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:53:39.810860 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-221fabf6-161b-4f89-bd6a-551b7288d224 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:39.811312 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-221fabf6-161b-4f89-bd6a-551b7288d224 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:39.812082 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-221fabf6-161b-4f89-bd6a-551b7288d224 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:39.812537 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-221fabf6-161b-4f89-bd6a-551b7288d224 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:40.009056 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-221fabf6-161b-4f89-bd6a-551b7288d224 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a641a08648b454780081ecc2e291066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a8451272cc41ebaf1598ed940bf09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:53:40.017210 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-221fabf6-161b-4f89-bd6a-551b7288d224 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/6f7de537-3c2b-4b45-a0da-e5b9ab7c169a" status: 200 len: 1682 microversion: 2.1 time: 0.218544 May 12 14:53:40.017781 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 352/696] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:53:39 2022] GET /compute/v2.1/servers/6f7de537-3c2b-4b45-a0da-e5b9ab7c169a => generated 1682 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:53:40.107089 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-ada4ab4a-ffcf-46f8-91e5-1e56368f67f5 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:40.108069 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-ada4ab4a-ffcf-46f8-91e5-1e56368f67f5 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:53:40.117472 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-ada4ab4a-ffcf-46f8-91e5-1e56368f67f5 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:40.117957 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-ada4ab4a-ffcf-46f8-91e5-1e56368f67f5 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:40.118936 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-ada4ab4a-ffcf-46f8-91e5-1e56368f67f5 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:40.119369 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-ada4ab4a-ffcf-46f8-91e5-1e56368f67f5 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:40.218434 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-0f5e4420-930a-44be-8c10-289e572ac71a tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:40.219817 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-0f5e4420-930a-44be-8c10-289e572ac71a tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] [instance: 70554c80-92d9-4b15-9510-b57a49d2c373] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:53:40.230192 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-0f5e4420-930a-44be-8c10-289e572ac71a tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:40.231037 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-0f5e4420-930a-44be-8c10-289e572ac71a tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:40.232910 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-0f5e4420-930a-44be-8c10-289e572ac71a tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:40.233463 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-0f5e4420-930a-44be-8c10-289e572ac71a tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:40.444374 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-0f5e4420-930a-44be-8c10-289e572ac71a tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298bd0429941448eae2e143f8210b53c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd2b6082f554c90b7b78f0a59634e80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:53:40.455966 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-0f5e4420-930a-44be-8c10-289e572ac71a tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] 10.222.0.49 "GET /compute/v2.1/servers/70554c80-92d9-4b15-9510-b57a49d2c373" status: 200 len: 1314 microversion: 2.1 time: 0.242918 May 12 14:53:40.468143 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 353/697] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:53:40 2022] GET /compute/v2.1/servers/70554c80-92d9-4b15-9510-b57a49d2c373 => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:53:40.619340 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-ada4ab4a-ffcf-46f8-91e5-1e56368f67f5 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:53:40.654508 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-ada4ab4a-ffcf-46f8-91e5-1e56368f67f5 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:53:40.656569 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-ada4ab4a-ffcf-46f8-91e5-1e56368f67f5 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:53:40.658355 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-ada4ab4a-ffcf-46f8-91e5-1e56368f67f5 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9" status: 200 len: 1723 microversion: 2.20 time: 0.555668 May 12 14:53:40.659560 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 345/698] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:53:40 2022] GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9 => generated 1723 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:53:40.989837 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [req-e6a9b7fd-bf5a-44f8-8e2f-63f636c22884 req-15cfb51a-9249-4c43-a1c6-73e77908d2c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "358a3c59-ec18-40a6-b2a2-d7a37b46d08f", "tag": "29d1dc1e-72a2-437b-94bf-fcacd84119d4"}]} {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:53:40.993783 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:53:40.993783 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: warnings.warn(msg) May 12 14:53:41.008521 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [req-e6a9b7fd-bf5a-44f8-8e2f-63f636c22884 req-15cfb51a-9249-4c43-a1c6-73e77908d2c0 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:41.009223 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [req-e6a9b7fd-bf5a-44f8-8e2f-63f636c22884 req-15cfb51a-9249-4c43-a1c6-73e77908d2c0 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:41.031302 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.compute.server_external_events [req-e6a9b7fd-bf5a-44f8-8e2f-63f636c22884 req-15cfb51a-9249-4c43-a1c6-73e77908d2c0 service nova] Creating event network-changed:29d1dc1e-72a2-437b-94bf-fcacd84119d4 for instance 358a3c59-ec18-40a6-b2a2-d7a37b46d08f on hv-cinder-83118 May 12 14:53:41.033758 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-6cfe9616-25ea-4580-8cb2-c192509d16d5 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:41.034379 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-6cfe9616-25ea-4580-8cb2-c192509d16d5 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 6f7de537-3c2b-4b45-a0da-e5b9ab7c169a] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:53:41.038889 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [req-e6a9b7fd-bf5a-44f8-8e2f-63f636c22884 req-15cfb51a-9249-4c43-a1c6-73e77908d2c0 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054110 May 12 14:53:41.040013 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 354/699] 10.222.0.49 () {64 vars in 1317 bytes} [Thu May 12 14:53:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:53:41.048006 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-6cfe9616-25ea-4580-8cb2-c192509d16d5 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:41.048747 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-6cfe9616-25ea-4580-8cb2-c192509d16d5 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:41.050268 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-6cfe9616-25ea-4580-8cb2-c192509d16d5 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:41.051060 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-6cfe9616-25ea-4580-8cb2-c192509d16d5 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:41.474828 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-fe355a24-035e-4209-9ccd-b01618ac3173 tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:41.476372 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-fe355a24-035e-4209-9ccd-b01618ac3173 tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] [instance: 70554c80-92d9-4b15-9510-b57a49d2c373] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:53:41.494577 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-fe355a24-035e-4209-9ccd-b01618ac3173 tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:41.495064 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-fe355a24-035e-4209-9ccd-b01618ac3173 tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:41.495863 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-fe355a24-035e-4209-9ccd-b01618ac3173 tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:41.499843 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-fe355a24-035e-4209-9ccd-b01618ac3173 tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:41.727824 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-6cfe9616-25ea-4580-8cb2-c192509d16d5 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a641a08648b454780081ecc2e291066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a8451272cc41ebaf1598ed940bf09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:53:41.741290 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-6cfe9616-25ea-4580-8cb2-c192509d16d5 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/6f7de537-3c2b-4b45-a0da-e5b9ab7c169a" status: 200 len: 1682 microversion: 2.1 time: 0.711611 May 12 14:53:41.741921 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 346/700] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:53:41 2022] GET /compute/v2.1/servers/6f7de537-3c2b-4b45-a0da-e5b9ab7c169a => generated 1682 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:53:41.760918 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-2951cb08-539a-4282-9535-bd5f56924618 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:41.761591 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-2951cb08-539a-4282-9535-bd5f56924618 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:53:41.770502 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-2951cb08-539a-4282-9535-bd5f56924618 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:41.771035 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-2951cb08-539a-4282-9535-bd5f56924618 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:41.771824 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-2951cb08-539a-4282-9535-bd5f56924618 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:41.773387 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-2951cb08-539a-4282-9535-bd5f56924618 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:42.209486 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-2951cb08-539a-4282-9535-bd5f56924618 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:53:42.219924 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-2951cb08-539a-4282-9535-bd5f56924618 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:53:42.221478 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-2951cb08-539a-4282-9535-bd5f56924618 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:53:42.222648 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-2951cb08-539a-4282-9535-bd5f56924618 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9" status: 200 len: 1366 microversion: 2.20 time: 0.467201 May 12 14:53:42.223769 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 347/701] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:53:41 2022] GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9 => generated 1366 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:53:42.288297 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-fe355a24-035e-4209-9ccd-b01618ac3173 tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298bd0429941448eae2e143f8210b53c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd2b6082f554c90b7b78f0a59634e80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:53:42.300765 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-fe355a24-035e-4209-9ccd-b01618ac3173 tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] 10.222.0.49 "GET /compute/v2.1/servers/70554c80-92d9-4b15-9510-b57a49d2c373" status: 200 len: 1314 microversion: 2.1 time: 0.830935 May 12 14:53:42.302012 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 355/702] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:53:41 2022] GET /compute/v2.1/servers/70554c80-92d9-4b15-9510-b57a49d2c373 => generated 1314 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:53:42.759256 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-ff55d83d-064c-4cd4-84ea-e5743caf59fd tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:42.760234 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-ff55d83d-064c-4cd4-84ea-e5743caf59fd tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 6f7de537-3c2b-4b45-a0da-e5b9ab7c169a] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:53:42.769286 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-ff55d83d-064c-4cd4-84ea-e5743caf59fd tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:42.769390 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-ff55d83d-064c-4cd4-84ea-e5743caf59fd tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:42.770751 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-ff55d83d-064c-4cd4-84ea-e5743caf59fd tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:42.771210 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-ff55d83d-064c-4cd4-84ea-e5743caf59fd tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:42.784146 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [req-f1bc2f4f-a104-4a4a-b52f-07c37064524a req-173d16f4-0e23-479f-979a-2f6337721db7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f7de537-3c2b-4b45-a0da-e5b9ab7c169a", "name": "network-vif-deleted", "tag": "ad55ba66-712c-4c11-9515-ff16c19a8b63"}]} {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:53:42.785780 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:53:42.785780 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: warnings.warn(msg) May 12 14:53:42.799881 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [req-f1bc2f4f-a104-4a4a-b52f-07c37064524a req-173d16f4-0e23-479f-979a-2f6337721db7 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:42.800326 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [req-f1bc2f4f-a104-4a4a-b52f-07c37064524a req-173d16f4-0e23-479f-979a-2f6337721db7 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:42.856971 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.compute.server_external_events [req-f1bc2f4f-a104-4a4a-b52f-07c37064524a req-173d16f4-0e23-479f-979a-2f6337721db7 service nova] Creating event network-vif-deleted:ad55ba66-712c-4c11-9515-ff16c19a8b63 for instance 6f7de537-3c2b-4b45-a0da-e5b9ab7c169a on hv-cinder-83118 May 12 14:53:42.875563 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [req-f1bc2f4f-a104-4a4a-b52f-07c37064524a req-173d16f4-0e23-479f-979a-2f6337721db7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.246501 May 12 14:53:42.879810 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 348/703] 10.222.0.49 () {64 vars in 1317 bytes} [Thu May 12 14:53:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:53:43.249240 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-ff55d83d-064c-4cd4-84ea-e5743caf59fd tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a641a08648b454780081ecc2e291066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a8451272cc41ebaf1598ed940bf09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:53:43.263268 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-0377c695-ca56-4bfb-8d02-befc9d07f4d3 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:43.263268 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-0377c695-ca56-4bfb-8d02-befc9d07f4d3 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:53:43.270861 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-ff55d83d-064c-4cd4-84ea-e5743caf59fd tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/6f7de537-3c2b-4b45-a0da-e5b9ab7c169a" status: 200 len: 1614 microversion: 2.1 time: 0.514444 May 12 14:53:43.273946 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 356/704] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:53:42 2022] GET /compute/v2.1/servers/6f7de537-3c2b-4b45-a0da-e5b9ab7c169a => generated 1614 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:53:43.285295 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-0377c695-ca56-4bfb-8d02-befc9d07f4d3 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:43.285971 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-0377c695-ca56-4bfb-8d02-befc9d07f4d3 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:43.286965 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-0377c695-ca56-4bfb-8d02-befc9d07f4d3 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:43.287768 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-0377c695-ca56-4bfb-8d02-befc9d07f4d3 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:43.318187 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-79288471-0944-4e29-b357-35cb516356c6 tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:43.319520 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-79288471-0944-4e29-b357-35cb516356c6 tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] [instance: 70554c80-92d9-4b15-9510-b57a49d2c373] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:53:43.331060 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-79288471-0944-4e29-b357-35cb516356c6 tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:43.331620 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-79288471-0944-4e29-b357-35cb516356c6 tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:43.333292 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-79288471-0944-4e29-b357-35cb516356c6 tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:43.333865 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-79288471-0944-4e29-b357-35cb516356c6 tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:43.363106 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.wsgi [None req-0377c695-ca56-4bfb-8d02-befc9d07f4d3 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] HTTP exception thrown: Instance a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9 could not be found. May 12 14:53:43.363757 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-0377c695-ca56-4bfb-8d02-befc9d07f4d3 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Returning 404 to user: Instance a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9 could not be found. {{(pid=102212) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 12 14:53:43.364696 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-0377c695-ca56-4bfb-8d02-befc9d07f4d3 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9" status: 404 len: 111 microversion: 2.20 time: 0.126825 May 12 14:53:43.365635 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 349/705] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:53:43 2022] GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9 => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 12 14:53:43.431764 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [req-7f0213ec-dead-435e-8b20-01c86437d139 req-b729a156-a772-4540-b230-2b5a9ea887dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9", "name": "network-vif-deleted", "tag": "892fd785-17e4-4442-9f7d-2e5d18b22e9f"}]} {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:53:43.433805 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:53:43.433805 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: warnings.warn(msg) May 12 14:53:43.449053 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [req-7f0213ec-dead-435e-8b20-01c86437d139 req-b729a156-a772-4540-b230-2b5a9ea887dd service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:43.449687 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [req-7f0213ec-dead-435e-8b20-01c86437d139 req-b729a156-a772-4540-b230-2b5a9ea887dd service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:43.469175 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.compute.server_external_events [req-7f0213ec-dead-435e-8b20-01c86437d139 req-b729a156-a772-4540-b230-2b5a9ea887dd service nova] Creating event network-vif-deleted:892fd785-17e4-4442-9f7d-2e5d18b22e9f for instance a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9 on hv-cinder-83118 May 12 14:53:43.474597 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [req-7f0213ec-dead-435e-8b20-01c86437d139 req-b729a156-a772-4540-b230-2b5a9ea887dd service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107635 May 12 14:53:43.475369 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 350/706] 10.222.0.49 () {64 vars in 1317 bytes} [Thu May 12 14:53:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:53:43.485970 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-f5009b3d-5ff7-44b0-a72a-a51ee55f1f2d tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '.version_select at 0x7ff77fbb3b80>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:43.569854 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-79288471-0944-4e29-b357-35cb516356c6 tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298bd0429941448eae2e143f8210b53c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd2b6082f554c90b7b78f0a59634e80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:53:43.578193 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-79288471-0944-4e29-b357-35cb516356c6 tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] 10.222.0.49 "GET /compute/v2.1/servers/70554c80-92d9-4b15-9510-b57a49d2c373" status: 200 len: 1314 microversion: 2.1 time: 0.264393 May 12 14:53:43.578759 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 357/707] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:53:43 2022] GET /compute/v2.1/servers/70554c80-92d9-4b15-9510-b57a49d2c373 => generated 1314 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:53:43.619804 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-f5009b3d-5ff7-44b0-a72a-a51ee55f1f2d tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1383614298" status: 204 len: 0 microversion: 2.20 time: 0.143051 May 12 14:53:43.620361 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 351/708] 10.222.0.49 () {60 vars in 1261 bytes} [Thu May 12 14:53:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1383614298 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 12 14:53:44.293160 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-da18f751-d10c-4be7-b0ed-4d22d4f6b644 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:44.293837 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-da18f751-d10c-4be7-b0ed-4d22d4f6b644 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 6f7de537-3c2b-4b45-a0da-e5b9ab7c169a] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:53:44.303723 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-da18f751-d10c-4be7-b0ed-4d22d4f6b644 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:44.304820 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-da18f751-d10c-4be7-b0ed-4d22d4f6b644 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:44.305778 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-da18f751-d10c-4be7-b0ed-4d22d4f6b644 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:44.306383 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-da18f751-d10c-4be7-b0ed-4d22d4f6b644 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:44.379125 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-b4503bfc-17b1-4d56-92fd-239918744123 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1213861708", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1481799217", "security_groups": [{"name": "tempest-secgroup-smoke-1612459297"}], "block_device_mapping_v2": [{"uuid": "11d1928c-fa9e-4f42-8e49-50976391c459", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c8a9b5d7-4b96-4319-809c-e3bf553d8492"}]}} {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:53:44.385802 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.wsgi [None req-da18f751-d10c-4be7-b0ed-4d22d4f6b644 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] HTTP exception thrown: Instance 6f7de537-3c2b-4b45-a0da-e5b9ab7c169a could not be found. May 12 14:53:44.387052 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-da18f751-d10c-4be7-b0ed-4d22d4f6b644 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Returning 404 to user: Instance 6f7de537-3c2b-4b45-a0da-e5b9ab7c169a could not be found. {{(pid=102213) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 12 14:53:44.387296 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-da18f751-d10c-4be7-b0ed-4d22d4f6b644 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/6f7de537-3c2b-4b45-a0da-e5b9ab7c169a" status: 404 len: 111 microversion: 2.1 time: 0.098751 May 12 14:53:44.388258 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 358/709] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:53:44 2022] GET /compute/v2.1/servers/6f7de537-3c2b-4b45-a0da-e5b9ab7c169a => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 14:53:44.397405 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-fed4ae50-8bfb-4338-8f8f-a337ca9ef6de tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '.version_select at 0x7ff77ea1fd30>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:44.559040 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-fed4ae50-8bfb-4338-8f8f-a337ca9ef6de tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1884114003" status: 202 len: 0 microversion: 2.1 time: 0.166632 May 12 14:53:44.559614 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 359/710] 10.222.0.49 () {58 vars in 1220 bytes} [Thu May 12 14:53:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1884114003 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 12 14:53:44.595400 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-f7ca93b3-96e8-4692-9ba3-7c205d180ace tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:44.596301 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-f7ca93b3-96e8-4692-9ba3-7c205d180ace tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] [instance: 70554c80-92d9-4b15-9510-b57a49d2c373] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:53:44.604799 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-f7ca93b3-96e8-4692-9ba3-7c205d180ace tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:44.605503 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-f7ca93b3-96e8-4692-9ba3-7c205d180ace tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:44.606433 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-f7ca93b3-96e8-4692-9ba3-7c205d180ace tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:44.607063 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-f7ca93b3-96e8-4692-9ba3-7c205d180ace tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:44.790365 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.network.neutron [None req-b4503bfc-17b1-4d56-92fd-239918744123 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] validate_networks() for [('c8a9b5d7-4b96-4319-809c-e3bf553d8492', None, None, None)] {{(pid=102212) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} May 12 14:53:44.898314 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-f7ca93b3-96e8-4692-9ba3-7c205d180ace tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298bd0429941448eae2e143f8210b53c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd2b6082f554c90b7b78f0a59634e80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:53:44.906604 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-f7ca93b3-96e8-4692-9ba3-7c205d180ace tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] 10.222.0.49 "GET /compute/v2.1/servers/70554c80-92d9-4b15-9510-b57a49d2c373" status: 200 len: 1314 microversion: 2.1 time: 0.314918 May 12 14:53:44.917345 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 360/711] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:53:44 2022] GET /compute/v2.1/servers/70554c80-92d9-4b15-9510-b57a49d2c373 => generated 1314 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:53:44.982881 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [req-a6581653-865f-4818-b1dc-2ae9f1d1348d req-aea963d4-0719-43c2-8c32-c2aba1426f99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70554c80-92d9-4b15-9510-b57a49d2c373", "name": "network-vif-plugged", "status": "completed", "tag": "3138fe9b-4e8e-48d7-aeee-07d15301d4c1"}]} {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:53:44.984772 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:53:44.984772 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: warnings.warn(msg) May 12 14:53:44.994089 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [req-a6581653-865f-4818-b1dc-2ae9f1d1348d req-aea963d4-0719-43c2-8c32-c2aba1426f99 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:44.994801 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [req-a6581653-865f-4818-b1dc-2ae9f1d1348d req-aea963d4-0719-43c2-8c32-c2aba1426f99 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:45.012306 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.compute.server_external_events [req-a6581653-865f-4818-b1dc-2ae9f1d1348d req-aea963d4-0719-43c2-8c32-c2aba1426f99 service nova] Creating event network-vif-plugged:3138fe9b-4e8e-48d7-aeee-07d15301d4c1 for instance 70554c80-92d9-4b15-9510-b57a49d2c373 on hv-cinder-83118 May 12 14:53:45.017441 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [req-a6581653-865f-4818-b1dc-2ae9f1d1348d req-aea963d4-0719-43c2-8c32-c2aba1426f99 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098753 May 12 14:53:45.018538 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 361/712] 10.222.0.49 () {64 vars in 1317 bytes} [Thu May 12 14:53:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:53:45.336378 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-83d753aa-d3fd-4728-bc96-43a2887e7949 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Action: 'create', calling method: .version_select at 0x7ff77e8da5e0>, body: {"keypair": {"name": "tempest-keypair-1387406749", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMccLGI69Rb4V57cg/CXLvoQZuRg9foOYHiK7T6huCENlPjdfEf20FTpCLMFM+MXwE5S4CRvUQZYWbI4Mvwd7RTguiDkRxIIhvBPjNdjpRwAxmQbYPR3smX4bbB29kkt5g=="}} {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:53:45.363231 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.quota [None req-83d753aa-d3fd-4728-bc96-43a2887e7949 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Getting quotas for project 5a45a5191eca43c2b8d3e9ea80a50b5e. Resources: {'key_pairs'} {{(pid=102213) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 12 14:53:45.367390 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.quota [None req-83d753aa-d3fd-4728-bc96-43a2887e7949 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Getting quotas for user 4214f9e24bfa4f25ae9efbb7fa909300 and project 5a45a5191eca43c2b8d3e9ea80a50b5e. Resources: {'key_pairs'} {{(pid=102213) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 12 14:53:45.553966 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-83d753aa-d3fd-4728-bc96-43a2887e7949 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.224264 May 12 14:53:45.555189 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 362/713] 10.222.0.49 () {62 vars in 1199 bytes} [Thu May 12 14:53:45 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 228 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) May 12 14:53:45.891721 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.virt.hardware [None req-b4503bfc-17b1-4d56-92fd-239918744123 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Flavor limits 0:0:0 {{(pid=102212) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 14:53:45.892361 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.virt.hardware [None req-b4503bfc-17b1-4d56-92fd-239918744123 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Image limits 0:0:0 {{(pid=102212) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 14:53:45.893071 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.virt.hardware [None req-b4503bfc-17b1-4d56-92fd-239918744123 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Flavor pref 0:0:0 {{(pid=102212) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 14:53:45.893588 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.virt.hardware [None req-b4503bfc-17b1-4d56-92fd-239918744123 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Image pref 0:0:0 {{(pid=102212) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 14:53:45.894112 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.virt.hardware [None req-b4503bfc-17b1-4d56-92fd-239918744123 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=102212) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 14:53:45.907691 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-b4503bfc-17b1-4d56-92fd-239918744123 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:45.908804 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-b4503bfc-17b1-4d56-92fd-239918744123 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:45.909470 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-b4503bfc-17b1-4d56-92fd-239918744123 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:45.910010 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-b4503bfc-17b1-4d56-92fd-239918744123 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:45.924622 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-4b56c223-f2e0-4c90-8ed1-46cb449bd6a9 tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:45.926258 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-4b56c223-f2e0-4c90-8ed1-46cb449bd6a9 tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] [instance: 70554c80-92d9-4b15-9510-b57a49d2c373] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:53:45.934258 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-4b56c223-f2e0-4c90-8ed1-46cb449bd6a9 tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:45.934642 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.quota [None req-b4503bfc-17b1-4d56-92fd-239918744123 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Getting quotas for project 235689d103ed4d0dbe7b78698395bd21. Resources: {'cores', 'ram', 'instances'} {{(pid=102212) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 12 14:53:45.935269 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-4b56c223-f2e0-4c90-8ed1-46cb449bd6a9 tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:45.936334 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-4b56c223-f2e0-4c90-8ed1-46cb449bd6a9 tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:45.936961 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-4b56c223-f2e0-4c90-8ed1-46cb449bd6a9 tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:45.939663 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.quota [None req-b4503bfc-17b1-4d56-92fd-239918744123 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Getting quotas for user fef8036bc3ad4725b3af2607ceb17c88 and project 235689d103ed4d0dbe7b78698395bd21. Resources: {'cores', 'ram', 'instances'} {{(pid=102212) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 12 14:53:46.036076 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-b4503bfc-17b1-4d56-92fd-239918744123 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Going to run 1 instances... {{(pid=102212) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 12 14:53:46.038305 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-b4503bfc-17b1-4d56-92fd-239918744123 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] [instance: 12704ca3-a417-4cab-9a2c-98b9275218eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='11d1928c-fa9e-4f42-8e49-50976391c459',volume_size=None,volume_type=None)] {{(pid=102212) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} May 12 14:53:46.139998 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-4b56c223-f2e0-4c90-8ed1-46cb449bd6a9 tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298bd0429941448eae2e143f8210b53c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd2b6082f554c90b7b78f0a59634e80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:53:46.150637 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-4b56c223-f2e0-4c90-8ed1-46cb449bd6a9 tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] 10.222.0.49 "GET /compute/v2.1/servers/70554c80-92d9-4b15-9510-b57a49d2c373" status: 200 len: 1314 microversion: 2.1 time: 0.229238 May 12 14:53:46.151766 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 363/714] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:53:45 2022] GET /compute/v2.1/servers/70554c80-92d9-4b15-9510-b57a49d2c373 => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:53:46.475057 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-1b118b7b-a688-40ca-98e6-6ab593b69511 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Action: 'create', calling method: .version_select at 0x7ff77e8da0d0>, body: {"keypair": {"name": "tempest-keypair-1183529730", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAZ9VuQTfoK2TThcxzYiW/0lupd5w4FttnBYJXUbt39IONnlBYARc03a0c/dRd6MxqF7yECiXwCy4wTRHQToVQxp4Wvv8vNQ019jiX38dCCs1ECtZWpBN9IqPOn1iatD2A=="}} {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:53:46.497065 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.quota [None req-1b118b7b-a688-40ca-98e6-6ab593b69511 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Getting quotas for project 67a8451272cc41ebaf1598ed940bf09a. Resources: {'key_pairs'} {{(pid=102213) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 12 14:53:46.500854 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.quota [None req-1b118b7b-a688-40ca-98e6-6ab593b69511 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Getting quotas for user 6a641a08648b454780081ecc2e291066 and project 67a8451272cc41ebaf1598ed940bf09a. Resources: {'key_pairs'} {{(pid=102213) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 12 14:53:46.579994 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-1b118b7b-a688-40ca-98e6-6ab593b69511 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.109156 May 12 14:53:46.580624 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 364/715] 10.222.0.49 () {60 vars in 1158 bytes} [Thu May 12 14:53:46 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 14:53:46.766865 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-b4503bfc-17b1-4d56-92fd-239918744123 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.391412 May 12 14:53:46.767854 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 352/716] 10.222.0.49 () {60 vars in 1146 bytes} [Thu May 12 14:53:44 2022] POST /compute/v2.1/servers => generated 406 bytes in 2393 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 12 14:53:46.777747 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-bcbb128b-528b-43cd-bd4c-37063b6e0a48 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:46.778358 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-bcbb128b-528b-43cd-bd4c-37063b6e0a48 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] [instance: 12704ca3-a417-4cab-9a2c-98b9275218eb] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:53:46.859829 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-bcbb128b-528b-43cd-bd4c-37063b6e0a48 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef8036bc3ad4725b3af2607ceb17c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235689d103ed4d0dbe7b78698395bd21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:53:46.866897 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-bcbb128b-528b-43cd-bd4c-37063b6e0a48 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] 10.222.0.49 "GET /compute/v2.1/servers/12704ca3-a417-4cab-9a2c-98b9275218eb" status: 200 len: 1095 microversion: 2.1 time: 0.092832 May 12 14:53:46.868020 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 365/717] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:53:46 2022] GET /compute/v2.1/servers/12704ca3-a417-4cab-9a2c-98b9275218eb => generated 1095 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:53:47.166912 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-efcfbcaa-6519-4686-9d7a-67dcc6262c49 tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:47.168256 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-efcfbcaa-6519-4686-9d7a-67dcc6262c49 tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] [instance: 70554c80-92d9-4b15-9510-b57a49d2c373] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:53:47.176637 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-efcfbcaa-6519-4686-9d7a-67dcc6262c49 tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:47.177166 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-efcfbcaa-6519-4686-9d7a-67dcc6262c49 tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:47.178054 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-efcfbcaa-6519-4686-9d7a-67dcc6262c49 tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:47.178563 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-efcfbcaa-6519-4686-9d7a-67dcc6262c49 tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:47.446144 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-efcfbcaa-6519-4686-9d7a-67dcc6262c49 tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298bd0429941448eae2e143f8210b53c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd2b6082f554c90b7b78f0a59634e80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:53:47.455338 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-efcfbcaa-6519-4686-9d7a-67dcc6262c49 tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] 10.222.0.49 "GET /compute/v2.1/servers/70554c80-92d9-4b15-9510-b57a49d2c373" status: 200 len: 1314 microversion: 2.1 time: 0.292479 May 12 14:53:47.456100 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 353/718] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:53:47 2022] GET /compute/v2.1/servers/70554c80-92d9-4b15-9510-b57a49d2c373 => generated 1314 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:53:47.883891 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-6c4f64df-7e93-42ee-a372-8a2ca269e9d0 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:47.884672 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-6c4f64df-7e93-42ee-a372-8a2ca269e9d0 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] [instance: 12704ca3-a417-4cab-9a2c-98b9275218eb] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:53:47.956660 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-6c4f64df-7e93-42ee-a372-8a2ca269e9d0 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef8036bc3ad4725b3af2607ceb17c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235689d103ed4d0dbe7b78698395bd21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:53:47.967222 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-6c4f64df-7e93-42ee-a372-8a2ca269e9d0 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] 10.222.0.49 "GET /compute/v2.1/servers/12704ca3-a417-4cab-9a2c-98b9275218eb" status: 200 len: 1095 microversion: 2.1 time: 0.087052 May 12 14:53:47.967768 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 366/719] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:53:47 2022] GET /compute/v2.1/servers/12704ca3-a417-4cab-9a2c-98b9275218eb => generated 1095 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:53:48.548570 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-6a4cc9c3-8e3f-4375-a64d-3bb9880c0f25 tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:48.549174 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-6a4cc9c3-8e3f-4375-a64d-3bb9880c0f25 tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] [instance: 70554c80-92d9-4b15-9510-b57a49d2c373] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:53:48.556544 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-6a4cc9c3-8e3f-4375-a64d-3bb9880c0f25 tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:48.557016 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-6a4cc9c3-8e3f-4375-a64d-3bb9880c0f25 tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:48.557798 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-6a4cc9c3-8e3f-4375-a64d-3bb9880c0f25 tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:48.558238 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-6a4cc9c3-8e3f-4375-a64d-3bb9880c0f25 tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:48.787942 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-6a4cc9c3-8e3f-4375-a64d-3bb9880c0f25 tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298bd0429941448eae2e143f8210b53c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd2b6082f554c90b7b78f0a59634e80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:53:48.796299 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-6a4cc9c3-8e3f-4375-a64d-3bb9880c0f25 tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] 10.222.0.49 "GET /compute/v2.1/servers/70554c80-92d9-4b15-9510-b57a49d2c373" status: 200 len: 1463 microversion: 2.1 time: 0.251426 May 12 14:53:48.797418 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 354/720] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:53:48 2022] GET /compute/v2.1/servers/70554c80-92d9-4b15-9510-b57a49d2c373 => generated 1463 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:53:48.866396 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-3536385c-de9a-481a-8561-99eb23b95d42 tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:48.866922 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-3536385c-de9a-481a-8561-99eb23b95d42 tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] [instance: 70554c80-92d9-4b15-9510-b57a49d2c373] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:53:48.874131 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-3536385c-de9a-481a-8561-99eb23b95d42 tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:48.874575 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-3536385c-de9a-481a-8561-99eb23b95d42 tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:48.875378 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-3536385c-de9a-481a-8561-99eb23b95d42 tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:48.875808 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-3536385c-de9a-481a-8561-99eb23b95d42 tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:48.938268 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-3536385c-de9a-481a-8561-99eb23b95d42 tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] [instance: 70554c80-92d9-4b15-9510-b57a49d2c373] Going to try to terminate instance {{(pid=102213) delete /opt/stack/nova/nova/compute/api.py:2562}} May 12 14:53:48.987283 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-7c283099-dca4-4a78-8639-56a56b6ab134 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:48.988155 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-7c283099-dca4-4a78-8639-56a56b6ab134 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] [instance: 12704ca3-a417-4cab-9a2c-98b9275218eb] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:53:48.998933 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-7c283099-dca4-4a78-8639-56a56b6ab134 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:48.999718 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-7c283099-dca4-4a78-8639-56a56b6ab134 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:49.001049 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-7c283099-dca4-4a78-8639-56a56b6ab134 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:49.001542 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-7c283099-dca4-4a78-8639-56a56b6ab134 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:49.161821 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-7c283099-dca4-4a78-8639-56a56b6ab134 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef8036bc3ad4725b3af2607ceb17c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235689d103ed4d0dbe7b78698395bd21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:53:49.173600 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-7c283099-dca4-4a78-8639-56a56b6ab134 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] 10.222.0.49 "GET /compute/v2.1/servers/12704ca3-a417-4cab-9a2c-98b9275218eb" status: 200 len: 1145 microversion: 2.1 time: 0.192576 May 12 14:53:49.174215 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 355/721] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:53:48 2022] GET /compute/v2.1/servers/12704ca3-a417-4cab-9a2c-98b9275218eb => generated 1145 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:53:49.552343 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-3536385c-de9a-481a-8561-99eb23b95d42 tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] 10.222.0.49 "DELETE /compute/v2.1/servers/70554c80-92d9-4b15-9510-b57a49d2c373" status: 204 len: 0 microversion: 2.1 time: 0.687163 May 12 14:53:49.553231 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 367/722] 10.222.0.49 () {58 vars in 1238 bytes} [Thu May 12 14:53:48 2022] DELETE /compute/v2.1/servers/70554c80-92d9-4b15-9510-b57a49d2c373 => generated 0 bytes in 691 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 14:53:49.561169 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-ce6b202d-1cb4-4943-ad47-6cc218c14a03 tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:49.561778 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-ce6b202d-1cb4-4943-ad47-6cc218c14a03 tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] [instance: 70554c80-92d9-4b15-9510-b57a49d2c373] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:53:49.570208 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-ce6b202d-1cb4-4943-ad47-6cc218c14a03 tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:49.570655 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-ce6b202d-1cb4-4943-ad47-6cc218c14a03 tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:49.571465 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-ce6b202d-1cb4-4943-ad47-6cc218c14a03 tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:49.571894 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-ce6b202d-1cb4-4943-ad47-6cc218c14a03 tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:49.787021 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-7c92ff98-3f51-4aff-969d-c6c83f54e917 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2066186185", "imageRef": "a4587ab2-5f51-46a3-a023-0e6778ccaaa1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "741e2b09-db65-4b92-97d4-0a9b29ee4ecf"}], "security_groups": [{"name": "tempest-securitygroup--1878370029"}], "key_name": "tempest-keypair-1387406749", "user_data": "}} {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:53:49.856377 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-ce6b202d-1cb4-4943-ad47-6cc218c14a03 tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298bd0429941448eae2e143f8210b53c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd2b6082f554c90b7b78f0a59634e80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:53:49.865310 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-ce6b202d-1cb4-4943-ad47-6cc218c14a03 tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] 10.222.0.49 "GET /compute/v2.1/servers/70554c80-92d9-4b15-9510-b57a49d2c373" status: 200 len: 1469 microversion: 2.1 time: 0.307768 May 12 14:53:49.866871 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 356/723] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:53:49 2022] GET /compute/v2.1/servers/70554c80-92d9-4b15-9510-b57a49d2c373 => generated 1469 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:53:49.903041 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.network.neutron [None req-7c92ff98-3f51-4aff-969d-c6c83f54e917 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] validate_networks() for [('741e2b09-db65-4b92-97d4-0a9b29ee4ecf', None, None, None)] {{(pid=102213) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} May 12 14:53:50.189338 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-d19668e8-b1a8-4ddc-8085-cc06be093744 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:50.196101 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-d19668e8-b1a8-4ddc-8085-cc06be093744 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] [instance: 12704ca3-a417-4cab-9a2c-98b9275218eb] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:53:50.197608 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-d19668e8-b1a8-4ddc-8085-cc06be093744 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:50.198054 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-d19668e8-b1a8-4ddc-8085-cc06be093744 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:50.199107 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-d19668e8-b1a8-4ddc-8085-cc06be093744 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:50.199547 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-d19668e8-b1a8-4ddc-8085-cc06be093744 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:50.405285 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-d19668e8-b1a8-4ddc-8085-cc06be093744 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef8036bc3ad4725b3af2607ceb17c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235689d103ed4d0dbe7b78698395bd21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:53:50.414204 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-d19668e8-b1a8-4ddc-8085-cc06be093744 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] 10.222.0.49 "GET /compute/v2.1/servers/12704ca3-a417-4cab-9a2c-98b9275218eb" status: 200 len: 1193 microversion: 2.1 time: 0.228500 May 12 14:53:50.414805 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 357/724] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:53:50 2022] GET /compute/v2.1/servers/12704ca3-a417-4cab-9a2c-98b9275218eb => generated 1193 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:53:50.673826 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-dd9a4d20-3a2e-4a62-9812-5da84e44f015 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-955575148", "imageRef": "a4587ab2-5f51-46a3-a023-0e6778ccaaa1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9862f13a-dccf-465d-abda-f29b2d232c04"}], "security_groups": [{"name": "tempest-securitygroup--1734304260"}], "key_name": "tempest-keypair-1183529730", "user_data": "}} {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:53:50.877690 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.network.neutron [None req-dd9a4d20-3a2e-4a62-9812-5da84e44f015 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] validate_networks() for [('9862f13a-dccf-465d-abda-f29b2d232c04', None, None, None)] {{(pid=102212) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} May 12 14:53:50.995116 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.virt.hardware [None req-7c92ff98-3f51-4aff-969d-c6c83f54e917 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Flavor limits 0:0:0 {{(pid=102213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 14:53:50.996165 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.virt.hardware [None req-7c92ff98-3f51-4aff-969d-c6c83f54e917 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Image limits 0:0:0 {{(pid=102213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 14:53:50.996890 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.virt.hardware [None req-7c92ff98-3f51-4aff-969d-c6c83f54e917 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Flavor pref 0:0:0 {{(pid=102213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 14:53:50.997399 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.virt.hardware [None req-7c92ff98-3f51-4aff-969d-c6c83f54e917 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Image pref 0:0:0 {{(pid=102213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 14:53:50.997820 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.virt.hardware [None req-7c92ff98-3f51-4aff-969d-c6c83f54e917 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=102213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 14:53:51.008976 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-7c92ff98-3f51-4aff-969d-c6c83f54e917 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:51.009436 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-7c92ff98-3f51-4aff-969d-c6c83f54e917 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:51.010629 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-7c92ff98-3f51-4aff-969d-c6c83f54e917 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:51.010755 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-7c92ff98-3f51-4aff-969d-c6c83f54e917 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:51.028637 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.quota [None req-7c92ff98-3f51-4aff-969d-c6c83f54e917 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Getting quotas for project 5a45a5191eca43c2b8d3e9ea80a50b5e. Resources: {'cores', 'ram', 'instances'} {{(pid=102213) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 12 14:53:51.035922 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.quota [None req-7c92ff98-3f51-4aff-969d-c6c83f54e917 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Getting quotas for user 4214f9e24bfa4f25ae9efbb7fa909300 and project 5a45a5191eca43c2b8d3e9ea80a50b5e. Resources: {'cores', 'ram', 'instances'} {{(pid=102213) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 12 14:53:51.055374 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-7c92ff98-3f51-4aff-969d-c6c83f54e917 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Going to run 1 instances... {{(pid=102213) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 12 14:53:51.058094 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-7c92ff98-3f51-4aff-969d-c6c83f54e917 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: 5184e752-c944-4ecd-a516-600944c18dc1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a4587ab2-5f51-46a3-a023-0e6778ccaaa1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=102213) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} May 12 14:53:51.309096 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-7c92ff98-3f51-4aff-969d-c6c83f54e917 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.509799 May 12 14:53:51.312195 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 368/725] 10.222.0.49 () {62 vars in 1187 bytes} [Thu May 12 14:53:49 2022] POST /compute/v2.1/servers => generated 402 bytes in 1531 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) May 12 14:53:51.318293 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-110e0c31-dd64-492c-aace-11cf42044d44 tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:51.319077 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-110e0c31-dd64-492c-aace-11cf42044d44 tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] [instance: 70554c80-92d9-4b15-9510-b57a49d2c373] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:53:51.326929 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-110e0c31-dd64-492c-aace-11cf42044d44 tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:51.327296 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-110e0c31-dd64-492c-aace-11cf42044d44 tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:51.328359 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-110e0c31-dd64-492c-aace-11cf42044d44 tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:51.328500 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-110e0c31-dd64-492c-aace-11cf42044d44 tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:51.563649 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.virt.hardware [None req-dd9a4d20-3a2e-4a62-9812-5da84e44f015 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Flavor limits 0:0:0 {{(pid=102212) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 14:53:51.564240 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.virt.hardware [None req-dd9a4d20-3a2e-4a62-9812-5da84e44f015 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Image limits 0:0:0 {{(pid=102212) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 14:53:51.565135 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.virt.hardware [None req-dd9a4d20-3a2e-4a62-9812-5da84e44f015 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Flavor pref 0:0:0 {{(pid=102212) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 14:53:51.566164 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.virt.hardware [None req-dd9a4d20-3a2e-4a62-9812-5da84e44f015 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Image pref 0:0:0 {{(pid=102212) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 14:53:51.566842 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.virt.hardware [None req-dd9a4d20-3a2e-4a62-9812-5da84e44f015 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=102212) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 14:53:51.577321 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-dd9a4d20-3a2e-4a62-9812-5da84e44f015 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:51.577907 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-dd9a4d20-3a2e-4a62-9812-5da84e44f015 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:51.578838 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-dd9a4d20-3a2e-4a62-9812-5da84e44f015 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:51.579667 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-dd9a4d20-3a2e-4a62-9812-5da84e44f015 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:51.604118 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.quota [None req-dd9a4d20-3a2e-4a62-9812-5da84e44f015 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Getting quotas for project 67a8451272cc41ebaf1598ed940bf09a. Resources: {'cores', 'ram', 'instances'} {{(pid=102212) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 12 14:53:51.610144 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.quota [None req-dd9a4d20-3a2e-4a62-9812-5da84e44f015 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Getting quotas for user 6a641a08648b454780081ecc2e291066 and project 67a8451272cc41ebaf1598ed940bf09a. Resources: {'cores', 'ram', 'instances'} {{(pid=102212) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 12 14:53:51.623168 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-dd9a4d20-3a2e-4a62-9812-5da84e44f015 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Going to run 1 instances... {{(pid=102212) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 12 14:53:51.625631 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-dd9a4d20-3a2e-4a62-9812-5da84e44f015 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 59dadfa9-df81-4e69-aa33-d99984dbebfc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a4587ab2-5f51-46a3-a023-0e6778ccaaa1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=102212) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} May 12 14:53:51.804145 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-110e0c31-dd64-492c-aace-11cf42044d44 tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298bd0429941448eae2e143f8210b53c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd2b6082f554c90b7b78f0a59634e80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:53:51.820545 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-110e0c31-dd64-492c-aace-11cf42044d44 tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] 10.222.0.49 "GET /compute/v2.1/servers/70554c80-92d9-4b15-9510-b57a49d2c373" status: 200 len: 1469 microversion: 2.1 time: 0.499742 May 12 14:53:51.820545 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 369/726] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:53:51 2022] GET /compute/v2.1/servers/70554c80-92d9-4b15-9510-b57a49d2c373 => generated 1469 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:53:51.828202 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-f935f35b-ce8f-4295-8968-07f56f99896f tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:51.829121 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-f935f35b-ce8f-4295-8968-07f56f99896f tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: 5184e752-c944-4ecd-a516-600944c18dc1] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:53:51.872706 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-dd9a4d20-3a2e-4a62-9812-5da84e44f015 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.202971 May 12 14:53:51.874707 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 358/727] 10.222.0.49 () {60 vars in 1146 bytes} [Thu May 12 14:53:50 2022] POST /compute/v2.1/servers => generated 402 bytes in 1206 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 12 14:53:51.879836 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-d7a2bc1b-cef9-4387-9bc9-b02ca401d7bb tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:51.880726 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-d7a2bc1b-cef9-4387-9bc9-b02ca401d7bb tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] [instance: 12704ca3-a417-4cab-9a2c-98b9275218eb] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:53:51.889772 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-d7a2bc1b-cef9-4387-9bc9-b02ca401d7bb tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:51.890556 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-d7a2bc1b-cef9-4387-9bc9-b02ca401d7bb tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:51.891684 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-d7a2bc1b-cef9-4387-9bc9-b02ca401d7bb tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:51.892302 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-d7a2bc1b-cef9-4387-9bc9-b02ca401d7bb tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:51.905880 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-f935f35b-ce8f-4295-8968-07f56f99896f tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:53:51.915108 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-f935f35b-ce8f-4295-8968-07f56f99896f tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:53:51.916976 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-f935f35b-ce8f-4295-8968-07f56f99896f tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:53:51.918470 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-f935f35b-ce8f-4295-8968-07f56f99896f tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1" status: 200 len: 1282 microversion: 2.20 time: 0.094111 May 12 14:53:51.919125 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 370/728] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:53:51 2022] GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1 => generated 1282 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:53:51.923715 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-d6d0ddc4-81e0-49f7-a936-abb282f949b8 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:51.924331 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-d6d0ddc4-81e0-49f7-a936-abb282f949b8 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 944e4e2e-d09f-4dd7-ac42-b037b09dc7c3] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:53:51.932448 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-d6d0ddc4-81e0-49f7-a936-abb282f949b8 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:51.932955 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-d6d0ddc4-81e0-49f7-a936-abb282f949b8 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:51.934241 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-d6d0ddc4-81e0-49f7-a936-abb282f949b8 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:51.934241 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-d6d0ddc4-81e0-49f7-a936-abb282f949b8 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:52.120130 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.objects.instance [None req-d6d0ddc4-81e0-49f7-a936-abb282f949b8 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lazy-loading 'services' on Instance uuid 944e4e2e-d09f-4dd7-ac42-b037b09dc7c3 {{(pid=102213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 12 14:53:52.414681 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-d7a2bc1b-cef9-4387-9bc9-b02ca401d7bb tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef8036bc3ad4725b3af2607ceb17c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235689d103ed4d0dbe7b78698395bd21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:53:52.425458 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-d7a2bc1b-cef9-4387-9bc9-b02ca401d7bb tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] 10.222.0.49 "GET /compute/v2.1/servers/12704ca3-a417-4cab-9a2c-98b9275218eb" status: 200 len: 1279 microversion: 2.1 time: 0.549420 May 12 14:53:52.426216 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 359/729] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:53:51 2022] GET /compute/v2.1/servers/12704ca3-a417-4cab-9a2c-98b9275218eb => generated 1279 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:53:52.431248 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-dfaf1beb-8373-4eae-ae40-b98012e91663 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:52.433880 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-dfaf1beb-8373-4eae-ae40-b98012e91663 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 59dadfa9-df81-4e69-aa33-d99984dbebfc] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:53:52.607926 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-dfaf1beb-8373-4eae-ae40-b98012e91663 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a641a08648b454780081ecc2e291066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a8451272cc41ebaf1598ed940bf09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:53:52.615943 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-dfaf1beb-8373-4eae-ae40-b98012e91663 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/59dadfa9-df81-4e69-aa33-d99984dbebfc" status: 200 len: 1241 microversion: 2.1 time: 0.188051 May 12 14:53:52.616694 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 360/730] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:53:52 2022] GET /compute/v2.1/servers/59dadfa9-df81-4e69-aa33-d99984dbebfc => generated 1241 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:53:52.755787 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-d6d0ddc4-81e0-49f7-a936-abb282f949b8 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "DELETE /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3/os-volume_attachments/88e73d66-9d0e-4fcd-8b2d-61400be6ff03" status: 202 len: 0 microversion: 2.1 time: 0.835350 May 12 14:53:52.782993 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 371/731] 10.222.0.49 () {58 vars in 1415 bytes} [Thu May 12 14:53:51 2022] DELETE /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3/os-volume_attachments/88e73d66-9d0e-4fcd-8b2d-61400be6ff03 => generated 0 bytes in 837 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 14:53:52.783398 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-c0e6cbdf-8cf3-4e6b-b58d-22e653e027b5 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:52.783398 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-c0e6cbdf-8cf3-4e6b-b58d-22e653e027b5 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 944e4e2e-d09f-4dd7-ac42-b037b09dc7c3] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:53:52.783398 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-c0e6cbdf-8cf3-4e6b-b58d-22e653e027b5 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:52.783398 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-c0e6cbdf-8cf3-4e6b-b58d-22e653e027b5 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:52.783763 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-c0e6cbdf-8cf3-4e6b-b58d-22e653e027b5 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:52.783763 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-c0e6cbdf-8cf3-4e6b-b58d-22e653e027b5 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:52.832989 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-cff0f123-a1d7-4526-a862-5c2be58d0748 tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:52.834200 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-cff0f123-a1d7-4526-a862-5c2be58d0748 tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] [instance: 70554c80-92d9-4b15-9510-b57a49d2c373] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:53:52.843572 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-cff0f123-a1d7-4526-a862-5c2be58d0748 tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:52.844935 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-cff0f123-a1d7-4526-a862-5c2be58d0748 tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:52.845947 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-cff0f123-a1d7-4526-a862-5c2be58d0748 tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:52.846582 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-cff0f123-a1d7-4526-a862-5c2be58d0748 tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:52.859362 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-c0e6cbdf-8cf3-4e6b-b58d-22e653e027b5 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093710 May 12 14:53:52.863377 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 361/732] 10.222.0.49 () {58 vars in 1301 bytes} [Thu May 12 14:53:52 2022] GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:53:52.937846 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-6893775b-87fc-4df6-9234-41dd0c82ccc7 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:52.939325 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-6893775b-87fc-4df6-9234-41dd0c82ccc7 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: 5184e752-c944-4ecd-a516-600944c18dc1] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:53:52.948979 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-6893775b-87fc-4df6-9234-41dd0c82ccc7 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:52.949941 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-6893775b-87fc-4df6-9234-41dd0c82ccc7 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:52.951158 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-6893775b-87fc-4df6-9234-41dd0c82ccc7 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:52.951875 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-6893775b-87fc-4df6-9234-41dd0c82ccc7 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:53.021831 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-cff0f123-a1d7-4526-a862-5c2be58d0748 tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298bd0429941448eae2e143f8210b53c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd2b6082f554c90b7b78f0a59634e80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:53:53.030741 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-cff0f123-a1d7-4526-a862-5c2be58d0748 tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] 10.222.0.49 "GET /compute/v2.1/servers/70554c80-92d9-4b15-9510-b57a49d2c373" status: 200 len: 1427 microversion: 2.1 time: 0.203740 May 12 14:53:53.032095 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 372/733] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:53:52 2022] GET /compute/v2.1/servers/70554c80-92d9-4b15-9510-b57a49d2c373 => generated 1427 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:53:53.037176 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [req-81366c46-acae-4289-ad30-e541b5d12f9d req-a931549e-767f-4d79-98d9-4fa3d97be53c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70554c80-92d9-4b15-9510-b57a49d2c373", "name": "network-vif-deleted", "tag": "3138fe9b-4e8e-48d7-aeee-07d15301d4c1"}]} {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:53:53.038985 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:53:53.038985 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: warnings.warn(msg) May 12 14:53:53.048182 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [req-81366c46-acae-4289-ad30-e541b5d12f9d req-a931549e-767f-4d79-98d9-4fa3d97be53c service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:53.048870 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [req-81366c46-acae-4289-ad30-e541b5d12f9d req-a931549e-767f-4d79-98d9-4fa3d97be53c service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:53.071902 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.compute.server_external_events [req-81366c46-acae-4289-ad30-e541b5d12f9d req-a931549e-767f-4d79-98d9-4fa3d97be53c service nova] Creating event network-vif-deleted:3138fe9b-4e8e-48d7-aeee-07d15301d4c1 for instance 70554c80-92d9-4b15-9510-b57a49d2c373 on hv-cinder-83118 May 12 14:53:53.077087 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [req-81366c46-acae-4289-ad30-e541b5d12f9d req-a931549e-767f-4d79-98d9-4fa3d97be53c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043428 May 12 14:53:53.077878 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 373/734] 10.222.0.49 () {64 vars in 1317 bytes} [Thu May 12 14:53:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:53:53.125188 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-6893775b-87fc-4df6-9234-41dd0c82ccc7 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:53:53.128660 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-6893775b-87fc-4df6-9234-41dd0c82ccc7 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:53:53.131038 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-6893775b-87fc-4df6-9234-41dd0c82ccc7 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:53:53.132169 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-6893775b-87fc-4df6-9234-41dd0c82ccc7 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1" status: 200 len: 1286 microversion: 2.20 time: 0.199967 May 12 14:53:53.133046 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 362/735] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:53:52 2022] GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1 => generated 1286 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:53:53.446981 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-368d3efd-26ea-4d66-90ea-a617b0480c9d tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:53.447803 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-368d3efd-26ea-4d66-90ea-a617b0480c9d tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] [instance: 12704ca3-a417-4cab-9a2c-98b9275218eb] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:53:53.457813 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-368d3efd-26ea-4d66-90ea-a617b0480c9d tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:53.458572 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-368d3efd-26ea-4d66-90ea-a617b0480c9d tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:53.459417 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-368d3efd-26ea-4d66-90ea-a617b0480c9d tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:53.459883 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-368d3efd-26ea-4d66-90ea-a617b0480c9d tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:53.639856 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-68913cc5-92a8-4603-a139-563e000acb41 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:53.643664 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-68913cc5-92a8-4603-a139-563e000acb41 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 59dadfa9-df81-4e69-aa33-d99984dbebfc] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:53:53.667974 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-68913cc5-92a8-4603-a139-563e000acb41 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:53.668464 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-68913cc5-92a8-4603-a139-563e000acb41 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:53.669368 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-68913cc5-92a8-4603-a139-563e000acb41 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:53.669999 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-68913cc5-92a8-4603-a139-563e000acb41 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:53.791823 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-68913cc5-92a8-4603-a139-563e000acb41 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a641a08648b454780081ecc2e291066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a8451272cc41ebaf1598ed940bf09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:53:53.800160 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-68913cc5-92a8-4603-a139-563e000acb41 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/59dadfa9-df81-4e69-aa33-d99984dbebfc" status: 200 len: 1245 microversion: 2.1 time: 0.171327 May 12 14:53:53.801151 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 363/736] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:53:53 2022] GET /compute/v2.1/servers/59dadfa9-df81-4e69-aa33-d99984dbebfc => generated 1245 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:53:53.873183 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-4ec34f38-c02c-46ab-b65f-3fd742910b96 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:53.879190 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-4ec34f38-c02c-46ab-b65f-3fd742910b96 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 944e4e2e-d09f-4dd7-ac42-b037b09dc7c3] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:53:53.882477 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-4ec34f38-c02c-46ab-b65f-3fd742910b96 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:53.883122 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-4ec34f38-c02c-46ab-b65f-3fd742910b96 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:53.884009 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-4ec34f38-c02c-46ab-b65f-3fd742910b96 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:53.884537 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-4ec34f38-c02c-46ab-b65f-3fd742910b96 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:53.960906 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-4ec34f38-c02c-46ab-b65f-3fd742910b96 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091520 May 12 14:53:53.963100 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 364/737] 10.222.0.49 () {58 vars in 1301 bytes} [Thu May 12 14:53:53 2022] GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 14:53:53.964181 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-368d3efd-26ea-4d66-90ea-a617b0480c9d tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef8036bc3ad4725b3af2607ceb17c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235689d103ed4d0dbe7b78698395bd21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:53:53.970680 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [req-2ade52a2-5f84-4db7-b123-d68e75a0d042 req-86801eaf-33d4-4ef7-94ed-fdd7f0e5ad02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12704ca3-a417-4cab-9a2c-98b9275218eb", "tag": "b2d377be-5a49-46c3-8536-f69f3d36a7e9"}]} {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:53:53.972270 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:53:53.972270 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: warnings.warn(msg) May 12 14:53:53.974712 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-368d3efd-26ea-4d66-90ea-a617b0480c9d tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] 10.222.0.49 "GET /compute/v2.1/servers/12704ca3-a417-4cab-9a2c-98b9275218eb" status: 200 len: 1279 microversion: 2.1 time: 0.535808 May 12 14:53:53.984004 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 374/738] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:53:53 2022] GET /compute/v2.1/servers/12704ca3-a417-4cab-9a2c-98b9275218eb => generated 1279 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:53:53.986486 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [req-2ade52a2-5f84-4db7-b123-d68e75a0d042 req-86801eaf-33d4-4ef7-94ed-fdd7f0e5ad02 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:53.986962 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [req-2ade52a2-5f84-4db7-b123-d68e75a0d042 req-86801eaf-33d4-4ef7-94ed-fdd7f0e5ad02 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:54.004640 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.compute.server_external_events [req-2ade52a2-5f84-4db7-b123-d68e75a0d042 req-86801eaf-33d4-4ef7-94ed-fdd7f0e5ad02 service nova] Creating event network-changed:b2d377be-5a49-46c3-8536-f69f3d36a7e9 for instance 12704ca3-a417-4cab-9a2c-98b9275218eb on hv-cinder-83118 May 12 14:53:54.011438 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [req-2ade52a2-5f84-4db7-b123-d68e75a0d042 req-86801eaf-33d4-4ef7-94ed-fdd7f0e5ad02 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046827 May 12 14:53:54.014987 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 365/739] 10.222.0.49 () {64 vars in 1317 bytes} [Thu May 12 14:53:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:53:54.048996 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-561d89f1-73cd-4cea-9604-d4871fd32955 tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:54.049683 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-561d89f1-73cd-4cea-9604-d4871fd32955 tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] [instance: 70554c80-92d9-4b15-9510-b57a49d2c373] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:53:54.057931 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-561d89f1-73cd-4cea-9604-d4871fd32955 tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:54.058541 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-561d89f1-73cd-4cea-9604-d4871fd32955 tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:54.059513 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-561d89f1-73cd-4cea-9604-d4871fd32955 tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:54.060176 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-561d89f1-73cd-4cea-9604-d4871fd32955 tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:54.133618 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-561d89f1-73cd-4cea-9604-d4871fd32955 tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:54.134078 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-561d89f1-73cd-4cea-9604-d4871fd32955 tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:54.134588 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.objects.instance [None req-561d89f1-73cd-4cea-9604-d4871fd32955 tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Lazy-loading 'fault' on Instance uuid 70554c80-92d9-4b15-9510-b57a49d2c373 {{(pid=102213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 12 14:53:54.150614 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-6a7866d0-f68d-4c43-929d-a91f74f4c443 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:54.151339 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-6a7866d0-f68d-4c43-929d-a91f74f4c443 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: 5184e752-c944-4ecd-a516-600944c18dc1] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:53:54.159257 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-6a7866d0-f68d-4c43-929d-a91f74f4c443 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:54.159981 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-6a7866d0-f68d-4c43-929d-a91f74f4c443 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:54.160751 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-6a7866d0-f68d-4c43-929d-a91f74f4c443 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:54.161182 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-6a7866d0-f68d-4c43-929d-a91f74f4c443 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:54.204020 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-561d89f1-73cd-4cea-9604-d4871fd32955 tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '298bd0429941448eae2e143f8210b53c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbd2b6082f554c90b7b78f0a59634e80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:53:54.219452 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-561d89f1-73cd-4cea-9604-d4871fd32955 tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] 10.222.0.49 "GET /compute/v2.1/servers/70554c80-92d9-4b15-9510-b57a49d2c373" status: 200 len: 1304 microversion: 2.1 time: 0.174680 May 12 14:53:54.235198 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 375/740] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:53:54 2022] GET /compute/v2.1/servers/70554c80-92d9-4b15-9510-b57a49d2c373 => generated 1304 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:53:54.305656 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-6a7866d0-f68d-4c43-929d-a91f74f4c443 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:53:54.319396 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-6a7866d0-f68d-4c43-929d-a91f74f4c443 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:53:54.321018 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-6a7866d0-f68d-4c43-929d-a91f74f4c443 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:53:54.322224 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-6a7866d0-f68d-4c43-929d-a91f74f4c443 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1" status: 200 len: 1278 microversion: 2.20 time: 0.175782 May 12 14:53:54.322891 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 366/741] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:53:54 2022] GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1 => generated 1278 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 14:53:54.818421 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-cf99d8a1-5d05-4c73-bbd6-fff0d793d082 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:54.820021 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-cf99d8a1-5d05-4c73-bbd6-fff0d793d082 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 59dadfa9-df81-4e69-aa33-d99984dbebfc] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:53:54.827613 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-cf99d8a1-5d05-4c73-bbd6-fff0d793d082 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:54.828368 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-cf99d8a1-5d05-4c73-bbd6-fff0d793d082 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:54.829552 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-cf99d8a1-5d05-4c73-bbd6-fff0d793d082 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:54.830232 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-cf99d8a1-5d05-4c73-bbd6-fff0d793d082 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:54.974297 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-f94ac853-6a5f-46e4-8c51-cb573802d9e3 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:54.975256 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-f94ac853-6a5f-46e4-8c51-cb573802d9e3 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 944e4e2e-d09f-4dd7-ac42-b037b09dc7c3] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:53:54.982378 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-f94ac853-6a5f-46e4-8c51-cb573802d9e3 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:54.982869 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-f94ac853-6a5f-46e4-8c51-cb573802d9e3 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:54.983842 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-f94ac853-6a5f-46e4-8c51-cb573802d9e3 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:54.984284 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-f94ac853-6a5f-46e4-8c51-cb573802d9e3 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:55.048159 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-f94ac853-6a5f-46e4-8c51-cb573802d9e3 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.078400 May 12 14:53:55.048743 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 367/742] 10.222.0.49 () {58 vars in 1301 bytes} [Thu May 12 14:53:54 2022] GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3/os-volume_attachments => generated 25 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 12 14:53:55.053948 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-c6cc7c22-1b11-40b6-9283-169c2e3e2eef tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:55.054355 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-c6cc7c22-1b11-40b6-9283-169c2e3e2eef tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] [instance: 12704ca3-a417-4cab-9a2c-98b9275218eb] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:53:55.061539 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-c6cc7c22-1b11-40b6-9283-169c2e3e2eef tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:55.061993 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-c6cc7c22-1b11-40b6-9283-169c2e3e2eef tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:55.062773 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-c6cc7c22-1b11-40b6-9283-169c2e3e2eef tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:55.063238 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-c6cc7c22-1b11-40b6-9283-169c2e3e2eef tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:55.279742 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-c6cc7c22-1b11-40b6-9283-169c2e3e2eef tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef8036bc3ad4725b3af2607ceb17c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235689d103ed4d0dbe7b78698395bd21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:53:55.280324 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-cf99d8a1-5d05-4c73-bbd6-fff0d793d082 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a641a08648b454780081ecc2e291066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a8451272cc41ebaf1598ed940bf09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:53:55.289516 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-cf99d8a1-5d05-4c73-bbd6-fff0d793d082 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/59dadfa9-df81-4e69-aa33-d99984dbebfc" status: 200 len: 1237 microversion: 2.1 time: 0.475779 May 12 14:53:55.289734 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-c6cc7c22-1b11-40b6-9283-169c2e3e2eef tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] 10.222.0.49 "GET /compute/v2.1/servers/12704ca3-a417-4cab-9a2c-98b9275218eb" status: 200 len: 1267 microversion: 2.1 time: 0.239769 May 12 14:53:55.290161 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 376/743] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:53:54 2022] GET /compute/v2.1/servers/59dadfa9-df81-4e69-aa33-d99984dbebfc => generated 1237 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:53:55.294886 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-c217557a-6ebd-44aa-aac8-b35b578c64d7 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:55.295696 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-c217557a-6ebd-44aa-aac8-b35b578c64d7 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 944e4e2e-d09f-4dd7-ac42-b037b09dc7c3] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:53:55.299307 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 368/744] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:53:55 2022] GET /compute/v2.1/servers/12704ca3-a417-4cab-9a2c-98b9275218eb => generated 1267 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:53:55.303983 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-c217557a-6ebd-44aa-aac8-b35b578c64d7 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:55.304139 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-57ddf8f9-50d9-4da8-a675-ebac496d3d45 tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:55.304436 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-c217557a-6ebd-44aa-aac8-b35b578c64d7 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:55.304800 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-57ddf8f9-50d9-4da8-a675-ebac496d3d45 tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] [instance: 70554c80-92d9-4b15-9510-b57a49d2c373] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:53:55.305340 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-c217557a-6ebd-44aa-aac8-b35b578c64d7 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:55.305951 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-c217557a-6ebd-44aa-aac8-b35b578c64d7 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:55.312375 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-57ddf8f9-50d9-4da8-a675-ebac496d3d45 tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:55.312909 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-57ddf8f9-50d9-4da8-a675-ebac496d3d45 tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:55.313758 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-57ddf8f9-50d9-4da8-a675-ebac496d3d45 tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:55.314269 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-57ddf8f9-50d9-4da8-a675-ebac496d3d45 tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:55.364245 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.wsgi [None req-57ddf8f9-50d9-4da8-a675-ebac496d3d45 tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] HTTP exception thrown: Instance 70554c80-92d9-4b15-9510-b57a49d2c373 could not be found. May 12 14:53:55.364817 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-57ddf8f9-50d9-4da8-a675-ebac496d3d45 tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] Returning 404 to user: Instance 70554c80-92d9-4b15-9510-b57a49d2c373 could not be found. {{(pid=102212) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 12 14:53:55.365637 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-57ddf8f9-50d9-4da8-a675-ebac496d3d45 tempest-VolumesNegativeTest-901826338 tempest-VolumesNegativeTest-901826338-project] 10.222.0.49 "GET /compute/v2.1/servers/70554c80-92d9-4b15-9510-b57a49d2c373" status: 404 len: 111 microversion: 2.1 time: 0.065259 May 12 14:53:55.366191 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 369/745] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:53:55 2022] GET /compute/v2.1/servers/70554c80-92d9-4b15-9510-b57a49d2c373 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 14:53:55.370320 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-c217557a-6ebd-44aa-aac8-b35b578c64d7 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 944e4e2e-d09f-4dd7-ac42-b037b09dc7c3] Going to try to terminate instance {{(pid=102213) delete /opt/stack/nova/nova/compute/api.py:2562}} May 12 14:53:55.370475 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-4db4e1ea-4e59-451a-8bde-7cd91c0e1dcf tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:55.371068 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-4db4e1ea-4e59-451a-8bde-7cd91c0e1dcf tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: 5184e752-c944-4ecd-a516-600944c18dc1] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:53:55.381965 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-4db4e1ea-4e59-451a-8bde-7cd91c0e1dcf tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:55.388733 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-4db4e1ea-4e59-451a-8bde-7cd91c0e1dcf tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:55.388733 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-4db4e1ea-4e59-451a-8bde-7cd91c0e1dcf tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:55.388733 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-4db4e1ea-4e59-451a-8bde-7cd91c0e1dcf tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:55.505399 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-4db4e1ea-4e59-451a-8bde-7cd91c0e1dcf tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:53:55.514109 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-4db4e1ea-4e59-451a-8bde-7cd91c0e1dcf tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:53:55.519926 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-4db4e1ea-4e59-451a-8bde-7cd91c0e1dcf tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:53:55.519926 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-4db4e1ea-4e59-451a-8bde-7cd91c0e1dcf tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1" status: 200 len: 1334 microversion: 2.20 time: 0.149653 May 12 14:53:55.519926 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 370/746] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:53:55 2022] GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1 => generated 1334 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:53:56.241421 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-c217557a-6ebd-44aa-aac8-b35b578c64d7 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "DELETE /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3" status: 204 len: 0 microversion: 2.1 time: 0.949773 May 12 14:53:56.243004 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 377/747] 10.222.0.49 () {58 vars in 1238 bytes} [Thu May 12 14:53:55 2022] DELETE /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3 => generated 0 bytes in 952 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 14:53:56.253229 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-0544a0ce-d123-4fe9-9c73-bbd454348a76 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:56.253229 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-0544a0ce-d123-4fe9-9c73-bbd454348a76 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 944e4e2e-d09f-4dd7-ac42-b037b09dc7c3] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:53:56.260703 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-0544a0ce-d123-4fe9-9c73-bbd454348a76 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:56.261219 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-0544a0ce-d123-4fe9-9c73-bbd454348a76 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:56.262003 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-0544a0ce-d123-4fe9-9c73-bbd454348a76 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:56.262482 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-0544a0ce-d123-4fe9-9c73-bbd454348a76 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:56.307432 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-00c206d7-d604-4608-bce0-48f47f2bdc45 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:56.308133 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-00c206d7-d604-4608-bce0-48f47f2bdc45 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] [instance: 12704ca3-a417-4cab-9a2c-98b9275218eb] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:53:56.315291 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-00c206d7-d604-4608-bce0-48f47f2bdc45 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:56.315737 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-00c206d7-d604-4608-bce0-48f47f2bdc45 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:56.317306 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-00c206d7-d604-4608-bce0-48f47f2bdc45 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:56.317742 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-00c206d7-d604-4608-bce0-48f47f2bdc45 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:56.463067 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-0544a0ce-d123-4fe9-9c73-bbd454348a76 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:53:56.471439 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-0544a0ce-d123-4fe9-9c73-bbd454348a76 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3" status: 200 len: 1687 microversion: 2.1 time: 0.224435 May 12 14:53:56.472001 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 371/748] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:53:56 2022] GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3 => generated 1687 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:53:56.485886 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-455a1113-5788-4bdc-9c5b-05655ba9d8cc tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:56.486499 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-455a1113-5788-4bdc-9c5b-05655ba9d8cc tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 59dadfa9-df81-4e69-aa33-d99984dbebfc] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:53:56.494488 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-455a1113-5788-4bdc-9c5b-05655ba9d8cc tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:56.494971 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-455a1113-5788-4bdc-9c5b-05655ba9d8cc tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:56.495741 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-455a1113-5788-4bdc-9c5b-05655ba9d8cc tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:56.496174 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-455a1113-5788-4bdc-9c5b-05655ba9d8cc tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:56.524435 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-00c206d7-d604-4608-bce0-48f47f2bdc45 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef8036bc3ad4725b3af2607ceb17c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235689d103ed4d0dbe7b78698395bd21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:53:56.534161 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-00c206d7-d604-4608-bce0-48f47f2bdc45 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] 10.222.0.49 "GET /compute/v2.1/servers/12704ca3-a417-4cab-9a2c-98b9275218eb" status: 200 len: 1267 microversion: 2.1 time: 0.230757 May 12 14:53:56.535549 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 378/749] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:53:56 2022] GET /compute/v2.1/servers/12704ca3-a417-4cab-9a2c-98b9275218eb => generated 1267 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:53:56.543000 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-e294e902-a2a9-45ac-8c50-5efc373b7a09 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:56.544083 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-e294e902-a2a9-45ac-8c50-5efc373b7a09 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: 5184e752-c944-4ecd-a516-600944c18dc1] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:53:56.552352 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e294e902-a2a9-45ac-8c50-5efc373b7a09 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:56.553059 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e294e902-a2a9-45ac-8c50-5efc373b7a09 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:56.554107 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e294e902-a2a9-45ac-8c50-5efc373b7a09 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:56.554752 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e294e902-a2a9-45ac-8c50-5efc373b7a09 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:56.673466 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-455a1113-5788-4bdc-9c5b-05655ba9d8cc tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a641a08648b454780081ecc2e291066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a8451272cc41ebaf1598ed940bf09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:53:56.673466 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-455a1113-5788-4bdc-9c5b-05655ba9d8cc tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/59dadfa9-df81-4e69-aa33-d99984dbebfc" status: 200 len: 1293 microversion: 2.1 time: 0.167554 May 12 14:53:56.673466 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 372/750] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:53:56 2022] GET /compute/v2.1/servers/59dadfa9-df81-4e69-aa33-d99984dbebfc => generated 1293 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:53:56.682332 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-e294e902-a2a9-45ac-8c50-5efc373b7a09 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:53:56.691683 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-e294e902-a2a9-45ac-8c50-5efc373b7a09 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:53:56.693225 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-e294e902-a2a9-45ac-8c50-5efc373b7a09 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:53:56.694275 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-e294e902-a2a9-45ac-8c50-5efc373b7a09 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1" status: 200 len: 1342 microversion: 2.20 time: 0.157600 May 12 14:53:56.694838 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 379/751] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:53:56 2022] GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1 => generated 1342 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:53:57.489535 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-0acd7226-7210-4b33-83c6-d18ed0f2902b tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:57.490982 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-0acd7226-7210-4b33-83c6-d18ed0f2902b tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 944e4e2e-d09f-4dd7-ac42-b037b09dc7c3] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:53:57.499877 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-0acd7226-7210-4b33-83c6-d18ed0f2902b tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:57.500601 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-0acd7226-7210-4b33-83c6-d18ed0f2902b tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:57.501647 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-0acd7226-7210-4b33-83c6-d18ed0f2902b tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:57.502427 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-0acd7226-7210-4b33-83c6-d18ed0f2902b tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:57.557511 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-e446d396-e693-4b3d-bb2c-afa0f0517a9f tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:57.557511 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-e446d396-e693-4b3d-bb2c-afa0f0517a9f tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] [instance: 12704ca3-a417-4cab-9a2c-98b9275218eb] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:53:57.563228 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e446d396-e693-4b3d-bb2c-afa0f0517a9f tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:57.563688 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e446d396-e693-4b3d-bb2c-afa0f0517a9f tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:57.564539 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e446d396-e693-4b3d-bb2c-afa0f0517a9f tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:57.564983 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e446d396-e693-4b3d-bb2c-afa0f0517a9f tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:57.814157 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-0acd7226-7210-4b33-83c6-d18ed0f2902b tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:53:57.826610 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-0acd7226-7210-4b33-83c6-d18ed0f2902b tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3" status: 200 len: 1687 microversion: 2.1 time: 0.341060 May 12 14:53:57.827219 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 373/752] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:53:57 2022] GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3 => generated 1687 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:53:57.831597 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-a451ef59-4659-49df-b306-9060e92721d6 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:57.832776 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-a451ef59-4659-49df-b306-9060e92721d6 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 59dadfa9-df81-4e69-aa33-d99984dbebfc] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:53:57.851253 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-a451ef59-4659-49df-b306-9060e92721d6 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:57.851718 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-a451ef59-4659-49df-b306-9060e92721d6 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:57.852506 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-a451ef59-4659-49df-b306-9060e92721d6 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:57.852968 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-a451ef59-4659-49df-b306-9060e92721d6 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:57.861519 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-e446d396-e693-4b3d-bb2c-afa0f0517a9f tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef8036bc3ad4725b3af2607ceb17c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235689d103ed4d0dbe7b78698395bd21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:53:57.884594 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-e446d396-e693-4b3d-bb2c-afa0f0517a9f tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] 10.222.0.49 "GET /compute/v2.1/servers/12704ca3-a417-4cab-9a2c-98b9275218eb" status: 200 len: 1267 microversion: 2.1 time: 0.334468 May 12 14:53:57.885368 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 380/753] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:53:57 2022] GET /compute/v2.1/servers/12704ca3-a417-4cab-9a2c-98b9275218eb => generated 1267 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:53:57.890026 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-35517a59-2553-4b5e-acf1-44a47555b10c tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:57.890747 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-35517a59-2553-4b5e-acf1-44a47555b10c tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: 5184e752-c944-4ecd-a516-600944c18dc1] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:53:57.900423 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-35517a59-2553-4b5e-acf1-44a47555b10c tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:57.900974 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-35517a59-2553-4b5e-acf1-44a47555b10c tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:57.901816 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-35517a59-2553-4b5e-acf1-44a47555b10c tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:57.902352 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-35517a59-2553-4b5e-acf1-44a47555b10c tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:57.975975 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-a451ef59-4659-49df-b306-9060e92721d6 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a641a08648b454780081ecc2e291066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a8451272cc41ebaf1598ed940bf09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:53:57.989537 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-a451ef59-4659-49df-b306-9060e92721d6 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/59dadfa9-df81-4e69-aa33-d99984dbebfc" status: 200 len: 1301 microversion: 2.1 time: 0.161126 May 12 14:53:57.990119 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 374/754] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:53:57 2022] GET /compute/v2.1/servers/59dadfa9-df81-4e69-aa33-d99984dbebfc => generated 1301 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:53:58.512337 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-35517a59-2553-4b5e-acf1-44a47555b10c tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:53:58.521223 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-35517a59-2553-4b5e-acf1-44a47555b10c tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:53:58.522979 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-35517a59-2553-4b5e-acf1-44a47555b10c tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:53:58.524306 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-35517a59-2553-4b5e-acf1-44a47555b10c tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1" status: 200 len: 1408 microversion: 2.20 time: 0.637555 May 12 14:53:58.525152 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 381/755] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:53:57 2022] GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1 => generated 1408 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:53:58.844676 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-604cb623-72b1-4776-b481-a76041fe76d1 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:58.845300 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-604cb623-72b1-4776-b481-a76041fe76d1 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 944e4e2e-d09f-4dd7-ac42-b037b09dc7c3] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:53:58.852560 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-604cb623-72b1-4776-b481-a76041fe76d1 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:58.856274 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-604cb623-72b1-4776-b481-a76041fe76d1 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:58.856274 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-604cb623-72b1-4776-b481-a76041fe76d1 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:58.856274 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-604cb623-72b1-4776-b481-a76041fe76d1 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:58.901642 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-d44d6ad9-f7d0-4743-97a8-55fb0a5791fd tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:58.903039 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-d44d6ad9-f7d0-4743-97a8-55fb0a5791fd tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] [instance: 12704ca3-a417-4cab-9a2c-98b9275218eb] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:53:58.914756 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-d44d6ad9-f7d0-4743-97a8-55fb0a5791fd tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:58.915639 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-d44d6ad9-f7d0-4743-97a8-55fb0a5791fd tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:58.916599 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-d44d6ad9-f7d0-4743-97a8-55fb0a5791fd tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:58.917023 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-d44d6ad9-f7d0-4743-97a8-55fb0a5791fd tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:59.264025 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-d44d6ad9-f7d0-4743-97a8-55fb0a5791fd tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef8036bc3ad4725b3af2607ceb17c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235689d103ed4d0dbe7b78698395bd21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:53:59.271101 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-d44d6ad9-f7d0-4743-97a8-55fb0a5791fd tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] 10.222.0.49 "GET /compute/v2.1/servers/12704ca3-a417-4cab-9a2c-98b9275218eb" status: 200 len: 1267 microversion: 2.1 time: 0.373359 May 12 14:53:59.272035 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 382/756] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:53:58 2022] GET /compute/v2.1/servers/12704ca3-a417-4cab-9a2c-98b9275218eb => generated 1267 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:53:59.277378 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-dadb77df-62b6-428f-9b9d-753d0e777cba tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:59.278093 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-dadb77df-62b6-428f-9b9d-753d0e777cba tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 59dadfa9-df81-4e69-aa33-d99984dbebfc] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:53:59.285896 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-dadb77df-62b6-428f-9b9d-753d0e777cba tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:59.286445 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-dadb77df-62b6-428f-9b9d-753d0e777cba tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:59.287322 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-dadb77df-62b6-428f-9b9d-753d0e777cba tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:59.287828 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-dadb77df-62b6-428f-9b9d-753d0e777cba tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:59.363689 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-604cb623-72b1-4776-b481-a76041fe76d1 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:53:59.372158 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-604cb623-72b1-4776-b481-a76041fe76d1 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3" status: 200 len: 1687 microversion: 2.1 time: 0.531367 May 12 14:53:59.372820 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 375/757] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:53:58 2022] GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3 => generated 1687 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:53:59.547022 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-759cf41a-fee8-4e3b-8707-76693d2a298b tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:53:59.552458 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-759cf41a-fee8-4e3b-8707-76693d2a298b tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: 5184e752-c944-4ecd-a516-600944c18dc1] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:53:59.569355 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-dadb77df-62b6-428f-9b9d-753d0e777cba tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a641a08648b454780081ecc2e291066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a8451272cc41ebaf1598ed940bf09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:53:59.569671 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-759cf41a-fee8-4e3b-8707-76693d2a298b tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:59.570343 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-759cf41a-fee8-4e3b-8707-76693d2a298b tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:59.571541 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-759cf41a-fee8-4e3b-8707-76693d2a298b tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:59.572188 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-759cf41a-fee8-4e3b-8707-76693d2a298b tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:59.580591 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-dadb77df-62b6-428f-9b9d-753d0e777cba tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/59dadfa9-df81-4e69-aa33-d99984dbebfc" status: 200 len: 1367 microversion: 2.1 time: 0.307024 May 12 14:53:59.581322 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 383/758] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:53:59 2022] GET /compute/v2.1/servers/59dadfa9-df81-4e69-aa33-d99984dbebfc => generated 1367 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:53:59.589220 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [req-b3d961ea-2f59-4093-953c-67988bd6a542 req-ef64cc23-ffbd-4495-8e03-b93111947608 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5184e752-c944-4ecd-a516-600944c18dc1", "tag": "74c60ae0-11dc-4a5e-afb9-11e124615006"}]} {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:53:59.592388 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:53:59.592388 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: warnings.warn(msg) May 12 14:53:59.601572 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [req-b3d961ea-2f59-4093-953c-67988bd6a542 req-ef64cc23-ffbd-4495-8e03-b93111947608 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:53:59.602211 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [req-b3d961ea-2f59-4093-953c-67988bd6a542 req-ef64cc23-ffbd-4495-8e03-b93111947608 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:53:59.622288 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.compute.server_external_events [req-b3d961ea-2f59-4093-953c-67988bd6a542 req-ef64cc23-ffbd-4495-8e03-b93111947608 service nova] Creating event network-changed:74c60ae0-11dc-4a5e-afb9-11e124615006 for instance 5184e752-c944-4ecd-a516-600944c18dc1 on hv-cinder-83118 May 12 14:53:59.627208 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [req-b3d961ea-2f59-4093-953c-67988bd6a542 req-ef64cc23-ffbd-4495-8e03-b93111947608 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042958 May 12 14:53:59.627893 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 384/759] 10.222.0.49 () {64 vars in 1317 bytes} [Thu May 12 14:53:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:53:59.996191 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-0c236344-60da-47f9-aef2-4ebd5738deb5 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:53:59.996972 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-0c236344-60da-47f9-aef2-4ebd5738deb5 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] [instance: 7855c920-9df4-495a-9733-78fe42b1705d] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:54:00.006270 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-0c236344-60da-47f9-aef2-4ebd5738deb5 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:00.007263 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-0c236344-60da-47f9-aef2-4ebd5738deb5 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:00.008486 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-0c236344-60da-47f9-aef2-4ebd5738deb5 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:00.009703 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-0c236344-60da-47f9-aef2-4ebd5738deb5 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:00.091172 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.objects.instance [None req-0c236344-60da-47f9-aef2-4ebd5738deb5 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lazy-loading 'flavor' on Instance uuid 7855c920-9df4-495a-9733-78fe42b1705d {{(pid=102213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 12 14:54:00.208787 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-759cf41a-fee8-4e3b-8707-76693d2a298b tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:54:00.221486 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-759cf41a-fee8-4e3b-8707-76693d2a298b tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:54:00.223259 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-759cf41a-fee8-4e3b-8707-76693d2a298b tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:54:00.224522 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-759cf41a-fee8-4e3b-8707-76693d2a298b tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1" status: 200 len: 1408 microversion: 2.20 time: 0.685337 May 12 14:54:00.225072 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 376/760] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:53:59 2022] GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1 => generated 1408 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 14:54:00.287898 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-ab7120b8-7354-4584-9b0a-45572871b978 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:54:00.288510 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-ab7120b8-7354-4584-9b0a-45572871b978 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] [instance: 12704ca3-a417-4cab-9a2c-98b9275218eb] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:54:00.295766 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-ab7120b8-7354-4584-9b0a-45572871b978 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:00.296209 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-ab7120b8-7354-4584-9b0a-45572871b978 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:00.296972 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-ab7120b8-7354-4584-9b0a-45572871b978 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:00.297869 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-ab7120b8-7354-4584-9b0a-45572871b978 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:00.704477 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-0c236344-60da-47f9-aef2-4ebd5738deb5 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] 10.222.0.49 "POST /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d/action" status: 202 len: 0 microversion: 2.1 time: 0.713085 May 12 14:54:00.708926 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 385/761] 10.222.0.49 () {60 vars in 1277 bytes} [Thu May 12 14:53:59 2022] POST /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d/action => generated 0 bytes in 716 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 14:54:00.711807 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-a70599fe-4965-474b-92eb-f7c275d58ab1 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:54:00.712706 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-a70599fe-4965-474b-92eb-f7c275d58ab1 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 944e4e2e-d09f-4dd7-ac42-b037b09dc7c3] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:54:00.721422 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-a70599fe-4965-474b-92eb-f7c275d58ab1 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:00.721873 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-a70599fe-4965-474b-92eb-f7c275d58ab1 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:00.722982 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-a70599fe-4965-474b-92eb-f7c275d58ab1 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:00.732368 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-a70599fe-4965-474b-92eb-f7c275d58ab1 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:01.063014 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-a70599fe-4965-474b-92eb-f7c275d58ab1 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:54:01.074195 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-a70599fe-4965-474b-92eb-f7c275d58ab1 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3" status: 200 len: 1687 microversion: 2.1 time: 0.367404 May 12 14:54:01.076474 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 386/762] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:54:00 2022] GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3 => generated 1687 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:54:01.084483 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-ab7120b8-7354-4584-9b0a-45572871b978 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef8036bc3ad4725b3af2607ceb17c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235689d103ed4d0dbe7b78698395bd21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:54:01.086990 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-ab7120b8-7354-4584-9b0a-45572871b978 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] 10.222.0.49 "GET /compute/v2.1/servers/12704ca3-a417-4cab-9a2c-98b9275218eb" status: 200 len: 1267 microversion: 2.1 time: 0.802745 May 12 14:54:01.088051 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 377/763] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:54:00 2022] GET /compute/v2.1/servers/12704ca3-a417-4cab-9a2c-98b9275218eb => generated 1267 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:54:01.090843 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-6148ac86-ea44-4307-a0f6-c6dbd42bfe44 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:54:01.091539 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-6148ac86-ea44-4307-a0f6-c6dbd42bfe44 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 59dadfa9-df81-4e69-aa33-d99984dbebfc] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:54:01.099730 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-2680318c-3b7a-491b-933f-8e4fdb14b077 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:54:01.100995 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-2680318c-3b7a-491b-933f-8e4fdb14b077 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] [instance: 7855c920-9df4-495a-9733-78fe42b1705d] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:54:01.101136 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-6148ac86-ea44-4307-a0f6-c6dbd42bfe44 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:01.101590 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-6148ac86-ea44-4307-a0f6-c6dbd42bfe44 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:01.102378 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-6148ac86-ea44-4307-a0f6-c6dbd42bfe44 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:01.102837 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-6148ac86-ea44-4307-a0f6-c6dbd42bfe44 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:01.126997 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-2680318c-3b7a-491b-933f-8e4fdb14b077 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:01.128161 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-2680318c-3b7a-491b-933f-8e4fdb14b077 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:01.129217 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-2680318c-3b7a-491b-933f-8e4fdb14b077 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:01.130674 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-2680318c-3b7a-491b-933f-8e4fdb14b077 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:01.336205 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-6148ac86-ea44-4307-a0f6-c6dbd42bfe44 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a641a08648b454780081ecc2e291066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a8451272cc41ebaf1598ed940bf09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:54:01.345817 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-6148ac86-ea44-4307-a0f6-c6dbd42bfe44 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/59dadfa9-df81-4e69-aa33-d99984dbebfc" status: 200 len: 1367 microversion: 2.1 time: 0.259321 May 12 14:54:01.346462 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 387/764] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:54:01 2022] GET /compute/v2.1/servers/59dadfa9-df81-4e69-aa33-d99984dbebfc => generated 1367 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:54:01.351174 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [req-2846fde2-87ab-44f5-9c4b-b5bd660e2bfe req-67c063b4-2c9e-46db-82d8-b05eda70b210 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59dadfa9-df81-4e69-aa33-d99984dbebfc", "tag": "00ee9d33-d084-4d18-b69d-a02dc7875eab"}]} {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:54:01.352727 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:54:01.352727 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: warnings.warn(msg) May 12 14:54:01.361031 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [req-2846fde2-87ab-44f5-9c4b-b5bd660e2bfe req-67c063b4-2c9e-46db-82d8-b05eda70b210 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:01.361481 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [req-2846fde2-87ab-44f5-9c4b-b5bd660e2bfe req-67c063b4-2c9e-46db-82d8-b05eda70b210 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:01.379640 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.compute.server_external_events [req-2846fde2-87ab-44f5-9c4b-b5bd660e2bfe req-67c063b4-2c9e-46db-82d8-b05eda70b210 service nova] Creating event network-changed:00ee9d33-d084-4d18-b69d-a02dc7875eab for instance 59dadfa9-df81-4e69-aa33-d99984dbebfc on hv-cinder-83118 May 12 14:54:01.384319 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [req-2846fde2-87ab-44f5-9c4b-b5bd660e2bfe req-67c063b4-2c9e-46db-82d8-b05eda70b210 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036700 May 12 14:54:01.385265 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 388/765] 10.222.0.49 () {64 vars in 1317 bytes} [Thu May 12 14:54:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:54:01.390466 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-4ce56d0e-1718-4517-8a50-5ac443c4e97c tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:54:01.391322 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-4ce56d0e-1718-4517-8a50-5ac443c4e97c tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: 5184e752-c944-4ecd-a516-600944c18dc1] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:54:01.398957 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-4ce56d0e-1718-4517-8a50-5ac443c4e97c tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:01.399522 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-4ce56d0e-1718-4517-8a50-5ac443c4e97c tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:01.400307 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-4ce56d0e-1718-4517-8a50-5ac443c4e97c tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:01.400748 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-4ce56d0e-1718-4517-8a50-5ac443c4e97c tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:01.648160 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-4ce56d0e-1718-4517-8a50-5ac443c4e97c tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:54:01.657159 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-4ce56d0e-1718-4517-8a50-5ac443c4e97c tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:54:01.658939 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-4ce56d0e-1718-4517-8a50-5ac443c4e97c tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:54:01.660759 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-4ce56d0e-1718-4517-8a50-5ac443c4e97c tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1" status: 200 len: 1408 microversion: 2.20 time: 0.274184 May 12 14:54:01.672333 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 389/766] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:54:01 2022] GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1 => generated 1408 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:54:01.767928 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-2680318c-3b7a-491b-933f-8e4fdb14b077 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6d3863350647cdb3091c1006d56c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfe8d8bce3f496d9162c7f9c8727273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:54:01.776454 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-2680318c-3b7a-491b-933f-8e4fdb14b077 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] 10.222.0.49 "GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d" status: 200 len: 1567 microversion: 2.1 time: 0.687317 May 12 14:54:01.777024 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 378/767] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:54:01 2022] GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d => generated 1567 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:54:02.092949 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-e1ab2d2a-5c16-43b7-b442-2a005b3f71f3 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:54:02.093568 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-e1ab2d2a-5c16-43b7-b442-2a005b3f71f3 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 944e4e2e-d09f-4dd7-ac42-b037b09dc7c3] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:54:02.102043 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e1ab2d2a-5c16-43b7-b442-2a005b3f71f3 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:02.102500 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e1ab2d2a-5c16-43b7-b442-2a005b3f71f3 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:02.103315 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e1ab2d2a-5c16-43b7-b442-2a005b3f71f3 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:02.103754 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e1ab2d2a-5c16-43b7-b442-2a005b3f71f3 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:02.104225 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-fa6cae02-44dd-4380-a2a5-9041b236712b tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:54:02.107459 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-fa6cae02-44dd-4380-a2a5-9041b236712b tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] [instance: 12704ca3-a417-4cab-9a2c-98b9275218eb] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:54:02.112525 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-fa6cae02-44dd-4380-a2a5-9041b236712b tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:02.113518 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-fa6cae02-44dd-4380-a2a5-9041b236712b tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:02.114546 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-fa6cae02-44dd-4380-a2a5-9041b236712b tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:02.115077 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-fa6cae02-44dd-4380-a2a5-9041b236712b tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:02.248175 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-e1ab2d2a-5c16-43b7-b442-2a005b3f71f3 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:54:02.256775 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-e1ab2d2a-5c16-43b7-b442-2a005b3f71f3 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3" status: 200 len: 1620 microversion: 2.1 time: 0.167447 May 12 14:54:02.257289 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 390/768] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:54:02 2022] GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3 => generated 1620 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:54:02.362832 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-87bbb801-3dc5-40dd-80e7-c7eac7930ae8 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:54:02.363545 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-87bbb801-3dc5-40dd-80e7-c7eac7930ae8 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 59dadfa9-df81-4e69-aa33-d99984dbebfc] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:54:02.380744 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-87bbb801-3dc5-40dd-80e7-c7eac7930ae8 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:02.381203 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-87bbb801-3dc5-40dd-80e7-c7eac7930ae8 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:02.381987 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-87bbb801-3dc5-40dd-80e7-c7eac7930ae8 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:02.382419 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-87bbb801-3dc5-40dd-80e7-c7eac7930ae8 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:02.672704 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-87bbb801-3dc5-40dd-80e7-c7eac7930ae8 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a641a08648b454780081ecc2e291066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a8451272cc41ebaf1598ed940bf09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:54:02.684176 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-87bbb801-3dc5-40dd-80e7-c7eac7930ae8 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/59dadfa9-df81-4e69-aa33-d99984dbebfc" status: 200 len: 1367 microversion: 2.1 time: 0.323653 May 12 14:54:02.684176 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 391/769] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:54:02 2022] GET /compute/v2.1/servers/59dadfa9-df81-4e69-aa33-d99984dbebfc => generated 1367 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:54:02.695899 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-0c8986e5-dad2-480f-8383-21132997d704 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:54:02.696699 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-0c8986e5-dad2-480f-8383-21132997d704 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: 5184e752-c944-4ecd-a516-600944c18dc1] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:54:02.705134 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-0c8986e5-dad2-480f-8383-21132997d704 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:02.705586 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-0c8986e5-dad2-480f-8383-21132997d704 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:02.706367 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-0c8986e5-dad2-480f-8383-21132997d704 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:02.706848 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-0c8986e5-dad2-480f-8383-21132997d704 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:02.872057 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-fa6cae02-44dd-4380-a2a5-9041b236712b tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef8036bc3ad4725b3af2607ceb17c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235689d103ed4d0dbe7b78698395bd21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:54:02.889237 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-fa6cae02-44dd-4380-a2a5-9041b236712b tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] 10.222.0.49 "GET /compute/v2.1/servers/12704ca3-a417-4cab-9a2c-98b9275218eb" status: 200 len: 1267 microversion: 2.1 time: 0.788489 May 12 14:54:02.890553 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 379/770] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:54:02 2022] GET /compute/v2.1/servers/12704ca3-a417-4cab-9a2c-98b9275218eb => generated 1267 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:54:02.900062 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-da9394f9-1e42-42a8-a50d-625f8aec00b6 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:54:02.900744 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-da9394f9-1e42-42a8-a50d-625f8aec00b6 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] [instance: 7855c920-9df4-495a-9733-78fe42b1705d] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:54:02.909615 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-da9394f9-1e42-42a8-a50d-625f8aec00b6 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:02.910737 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-da9394f9-1e42-42a8-a50d-625f8aec00b6 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:02.911730 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-da9394f9-1e42-42a8-a50d-625f8aec00b6 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:02.912308 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-da9394f9-1e42-42a8-a50d-625f8aec00b6 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:03.000538 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-0c8986e5-dad2-480f-8383-21132997d704 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:54:03.009973 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-0c8986e5-dad2-480f-8383-21132997d704 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:54:03.011537 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-0c8986e5-dad2-480f-8383-21132997d704 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:54:03.012622 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-0c8986e5-dad2-480f-8383-21132997d704 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1" status: 200 len: 1408 microversion: 2.20 time: 0.327538 May 12 14:54:03.018869 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 392/771] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:54:02 2022] GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1 => generated 1408 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:54:03.274309 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-6dbe01f1-9c6d-4dfa-8caa-137ddf4229e7 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:54:03.275024 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-6dbe01f1-9c6d-4dfa-8caa-137ddf4229e7 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 944e4e2e-d09f-4dd7-ac42-b037b09dc7c3] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:54:03.289322 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-6dbe01f1-9c6d-4dfa-8caa-137ddf4229e7 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:03.291864 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-6dbe01f1-9c6d-4dfa-8caa-137ddf4229e7 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:03.293222 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-6dbe01f1-9c6d-4dfa-8caa-137ddf4229e7 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:03.294082 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-6dbe01f1-9c6d-4dfa-8caa-137ddf4229e7 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:03.348309 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-da9394f9-1e42-42a8-a50d-625f8aec00b6 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6d3863350647cdb3091c1006d56c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfe8d8bce3f496d9162c7f9c8727273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:54:03.358697 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-da9394f9-1e42-42a8-a50d-625f8aec00b6 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] 10.222.0.49 "GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d" status: 200 len: 1567 microversion: 2.1 time: 0.466261 May 12 14:54:03.360825 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 380/772] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:54:02 2022] GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d => generated 1567 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:54:03.437393 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [req-c8488379-7f83-4e52-9b63-0fa4ad6d09f3 req-bea55e53-fc69-4be8-9097-98e3e342f019 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "944e4e2e-d09f-4dd7-ac42-b037b09dc7c3", "name": "network-vif-deleted", "tag": "cb1e67a7-74a2-404f-8058-06c175243b15"}]} {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:54:03.439060 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:54:03.439060 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: warnings.warn(msg) May 12 14:54:03.448917 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [req-c8488379-7f83-4e52-9b63-0fa4ad6d09f3 req-bea55e53-fc69-4be8-9097-98e3e342f019 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:03.449677 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [req-c8488379-7f83-4e52-9b63-0fa4ad6d09f3 req-bea55e53-fc69-4be8-9097-98e3e342f019 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:03.471174 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.compute.server_external_events [req-c8488379-7f83-4e52-9b63-0fa4ad6d09f3 req-bea55e53-fc69-4be8-9097-98e3e342f019 service nova] Creating event network-vif-deleted:cb1e67a7-74a2-404f-8058-06c175243b15 for instance 944e4e2e-d09f-4dd7-ac42-b037b09dc7c3 on hv-cinder-83118 May 12 14:54:03.476926 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [req-c8488379-7f83-4e52-9b63-0fa4ad6d09f3 req-bea55e53-fc69-4be8-9097-98e3e342f019 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047168 May 12 14:54:03.478112 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 381/773] 10.222.0.49 () {64 vars in 1317 bytes} [Thu May 12 14:54:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 14:54:03.496384 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-6dbe01f1-9c6d-4dfa-8caa-137ddf4229e7 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:54:03.506083 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-6dbe01f1-9c6d-4dfa-8caa-137ddf4229e7 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3" status: 200 len: 1329 microversion: 2.1 time: 0.235668 May 12 14:54:03.507180 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 393/774] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:54:03 2022] GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3 => generated 1329 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:54:03.701731 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-2b70e8da-2b85-45fd-8894-4db86a0f20e3 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:54:03.702573 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-2b70e8da-2b85-45fd-8894-4db86a0f20e3 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 59dadfa9-df81-4e69-aa33-d99984dbebfc] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:54:03.710748 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-2b70e8da-2b85-45fd-8894-4db86a0f20e3 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:03.711510 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-2b70e8da-2b85-45fd-8894-4db86a0f20e3 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:03.712406 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-2b70e8da-2b85-45fd-8894-4db86a0f20e3 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:03.713082 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-2b70e8da-2b85-45fd-8894-4db86a0f20e3 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:03.914759 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-5604e38e-858b-48a5-813d-75afd34ebdae tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:54:03.915601 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-5604e38e-858b-48a5-813d-75afd34ebdae tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] [instance: 12704ca3-a417-4cab-9a2c-98b9275218eb] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:54:03.923145 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-5604e38e-858b-48a5-813d-75afd34ebdae tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:03.923801 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-5604e38e-858b-48a5-813d-75afd34ebdae tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:03.925219 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-5604e38e-858b-48a5-813d-75afd34ebdae tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:03.926568 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-5604e38e-858b-48a5-813d-75afd34ebdae tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:04.086725 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-2b70e8da-2b85-45fd-8894-4db86a0f20e3 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a641a08648b454780081ecc2e291066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a8451272cc41ebaf1598ed940bf09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:54:04.096519 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-2b70e8da-2b85-45fd-8894-4db86a0f20e3 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/59dadfa9-df81-4e69-aa33-d99984dbebfc" status: 200 len: 1367 microversion: 2.1 time: 0.399235 May 12 14:54:04.097992 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 382/775] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:54:03 2022] GET /compute/v2.1/servers/59dadfa9-df81-4e69-aa33-d99984dbebfc => generated 1367 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:54:04.107513 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-e080f504-4c3a-4682-92d7-5076a4bcf662 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:54:04.108404 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-e080f504-4c3a-4682-92d7-5076a4bcf662 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: 5184e752-c944-4ecd-a516-600944c18dc1] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:54:04.117110 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-e080f504-4c3a-4682-92d7-5076a4bcf662 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:04.117930 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-e080f504-4c3a-4682-92d7-5076a4bcf662 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:04.118940 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-e080f504-4c3a-4682-92d7-5076a4bcf662 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:04.119529 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-e080f504-4c3a-4682-92d7-5076a4bcf662 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:04.156157 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-5604e38e-858b-48a5-813d-75afd34ebdae tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef8036bc3ad4725b3af2607ceb17c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235689d103ed4d0dbe7b78698395bd21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:54:04.166526 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-5604e38e-858b-48a5-813d-75afd34ebdae tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] 10.222.0.49 "GET /compute/v2.1/servers/12704ca3-a417-4cab-9a2c-98b9275218eb" status: 200 len: 1267 microversion: 2.1 time: 0.256815 May 12 14:54:04.169493 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 394/776] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:54:03 2022] GET /compute/v2.1/servers/12704ca3-a417-4cab-9a2c-98b9275218eb => generated 1267 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:54:04.365869 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-e080f504-4c3a-4682-92d7-5076a4bcf662 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:54:04.376871 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-e080f504-4c3a-4682-92d7-5076a4bcf662 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:54:04.378452 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-e080f504-4c3a-4682-92d7-5076a4bcf662 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:54:04.379630 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-e080f504-4c3a-4682-92d7-5076a4bcf662 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1" status: 200 len: 1408 microversion: 2.20 time: 0.280459 May 12 14:54:04.380192 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 383/777] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:54:04 2022] GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1 => generated 1408 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:54:04.386275 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-0f5de1b8-bf2d-4e9f-add7-fcc4077065d2 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:54:04.387742 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-0f5de1b8-bf2d-4e9f-add7-fcc4077065d2 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] [instance: 7855c920-9df4-495a-9733-78fe42b1705d] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:54:04.396031 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-0f5de1b8-bf2d-4e9f-add7-fcc4077065d2 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:04.396487 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-0f5de1b8-bf2d-4e9f-add7-fcc4077065d2 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:04.397452 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-0f5de1b8-bf2d-4e9f-add7-fcc4077065d2 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:04.397896 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-0f5de1b8-bf2d-4e9f-add7-fcc4077065d2 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:04.523490 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-ced4c8dc-05a0-4393-b9b2-ac4de222b0a7 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:54:04.524099 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-ced4c8dc-05a0-4393-b9b2-ac4de222b0a7 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 944e4e2e-d09f-4dd7-ac42-b037b09dc7c3] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:54:04.533267 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-ced4c8dc-05a0-4393-b9b2-ac4de222b0a7 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:04.534299 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-ced4c8dc-05a0-4393-b9b2-ac4de222b0a7 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:04.540126 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-ced4c8dc-05a0-4393-b9b2-ac4de222b0a7 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:04.540126 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-ced4c8dc-05a0-4393-b9b2-ac4de222b0a7 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:04.599914 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.wsgi [None req-ced4c8dc-05a0-4393-b9b2-ac4de222b0a7 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] HTTP exception thrown: Instance 944e4e2e-d09f-4dd7-ac42-b037b09dc7c3 could not be found. May 12 14:54:04.601003 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-ced4c8dc-05a0-4393-b9b2-ac4de222b0a7 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Returning 404 to user: Instance 944e4e2e-d09f-4dd7-ac42-b037b09dc7c3 could not be found. {{(pid=102212) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 12 14:54:04.602130 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-ced4c8dc-05a0-4393-b9b2-ac4de222b0a7 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3" status: 404 len: 111 microversion: 2.1 time: 0.082366 May 12 14:54:04.606569 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 384/778] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:54:04 2022] GET /compute/v2.1/servers/944e4e2e-d09f-4dd7-ac42-b037b09dc7c3 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 12 14:54:04.611871 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-4bae74f4-2ca1-4b98-a785-9f1e98dfebae tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '.version_select at 0x7ff77e52caf0>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:54:04.633831 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-0f5de1b8-bf2d-4e9f-add7-fcc4077065d2 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6d3863350647cdb3091c1006d56c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfe8d8bce3f496d9162c7f9c8727273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:54:04.642365 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-0f5de1b8-bf2d-4e9f-add7-fcc4077065d2 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] 10.222.0.49 "GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d" status: 200 len: 1567 microversion: 2.1 time: 0.268333 May 12 14:54:04.643072 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 395/779] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:54:04 2022] GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d => generated 1567 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:54:04.733693 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-4bae74f4-2ca1-4b98-a785-9f1e98dfebae tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1503865316" status: 202 len: 0 microversion: 2.1 time: 0.125915 May 12 14:54:04.738584 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 385/780] 10.222.0.49 () {58 vars in 1220 bytes} [Thu May 12 14:54:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1503865316 => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 14:54:05.113921 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-85798f91-ec67-4407-bb42-84952f0be026 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:54:05.114536 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-85798f91-ec67-4407-bb42-84952f0be026 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 59dadfa9-df81-4e69-aa33-d99984dbebfc] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:54:05.121968 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-85798f91-ec67-4407-bb42-84952f0be026 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:05.122408 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-85798f91-ec67-4407-bb42-84952f0be026 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:05.123193 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-85798f91-ec67-4407-bb42-84952f0be026 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:05.123625 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-85798f91-ec67-4407-bb42-84952f0be026 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:05.184835 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-933a5254-f66a-4c36-8c68-7984a07695af tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:54:05.185948 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-933a5254-f66a-4c36-8c68-7984a07695af tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] [instance: 12704ca3-a417-4cab-9a2c-98b9275218eb] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:54:05.193719 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-933a5254-f66a-4c36-8c68-7984a07695af tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:05.194478 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-933a5254-f66a-4c36-8c68-7984a07695af tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:05.195619 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-933a5254-f66a-4c36-8c68-7984a07695af tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:05.196213 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-933a5254-f66a-4c36-8c68-7984a07695af tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:05.352842 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-85798f91-ec67-4407-bb42-84952f0be026 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a641a08648b454780081ecc2e291066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a8451272cc41ebaf1598ed940bf09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:54:05.361735 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-85798f91-ec67-4407-bb42-84952f0be026 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/59dadfa9-df81-4e69-aa33-d99984dbebfc" status: 200 len: 1367 microversion: 2.1 time: 0.251575 May 12 14:54:05.362552 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 396/781] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:54:05 2022] GET /compute/v2.1/servers/59dadfa9-df81-4e69-aa33-d99984dbebfc => generated 1367 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:54:05.397977 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-72a481a8-cbea-4539-8ed5-92dfb1e1ac69 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:54:05.398659 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-72a481a8-cbea-4539-8ed5-92dfb1e1ac69 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: 5184e752-c944-4ecd-a516-600944c18dc1] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:54:05.407153 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-72a481a8-cbea-4539-8ed5-92dfb1e1ac69 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:05.407769 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-72a481a8-cbea-4539-8ed5-92dfb1e1ac69 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:05.408833 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-72a481a8-cbea-4539-8ed5-92dfb1e1ac69 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:05.409291 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-72a481a8-cbea-4539-8ed5-92dfb1e1ac69 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:05.635484 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-72a481a8-cbea-4539-8ed5-92dfb1e1ac69 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:54:05.645412 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-72a481a8-cbea-4539-8ed5-92dfb1e1ac69 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:54:05.647119 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-72a481a8-cbea-4539-8ed5-92dfb1e1ac69 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:54:05.648923 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-72a481a8-cbea-4539-8ed5-92dfb1e1ac69 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1" status: 200 len: 1408 microversion: 2.20 time: 0.255260 May 12 14:54:05.658960 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 397/782] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:54:05 2022] GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1 => generated 1408 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 14:54:05.662775 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-d1f2fc3f-94ec-4afe-86c4-afecfd4ac23f tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:54:05.663417 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-d1f2fc3f-94ec-4afe-86c4-afecfd4ac23f tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] [instance: 7855c920-9df4-495a-9733-78fe42b1705d] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:54:05.670986 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-d1f2fc3f-94ec-4afe-86c4-afecfd4ac23f tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:05.671502 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-d1f2fc3f-94ec-4afe-86c4-afecfd4ac23f tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:05.672290 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-d1f2fc3f-94ec-4afe-86c4-afecfd4ac23f tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:05.672725 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-d1f2fc3f-94ec-4afe-86c4-afecfd4ac23f tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:05.805250 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-933a5254-f66a-4c36-8c68-7984a07695af tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef8036bc3ad4725b3af2607ceb17c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235689d103ed4d0dbe7b78698395bd21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:54:05.822451 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-933a5254-f66a-4c36-8c68-7984a07695af tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] 10.222.0.49 "GET /compute/v2.1/servers/12704ca3-a417-4cab-9a2c-98b9275218eb" status: 200 len: 1267 microversion: 2.1 time: 0.641185 May 12 14:54:05.823933 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 386/783] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:54:05 2022] GET /compute/v2.1/servers/12704ca3-a417-4cab-9a2c-98b9275218eb => generated 1267 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:54:06.025493 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-d1f2fc3f-94ec-4afe-86c4-afecfd4ac23f tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6d3863350647cdb3091c1006d56c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfe8d8bce3f496d9162c7f9c8727273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:54:06.034665 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-d1f2fc3f-94ec-4afe-86c4-afecfd4ac23f tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] 10.222.0.49 "GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d" status: 200 len: 1567 microversion: 2.1 time: 0.378082 May 12 14:54:06.035253 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 398/784] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:54:05 2022] GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d => generated 1567 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:54:06.378711 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-cfa574d2-40d1-4fce-ae37-036ab7eab224 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:54:06.379613 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-cfa574d2-40d1-4fce-ae37-036ab7eab224 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 59dadfa9-df81-4e69-aa33-d99984dbebfc] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:54:06.387271 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-cfa574d2-40d1-4fce-ae37-036ab7eab224 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:06.387822 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-cfa574d2-40d1-4fce-ae37-036ab7eab224 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:06.388804 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-cfa574d2-40d1-4fce-ae37-036ab7eab224 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:06.389436 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-cfa574d2-40d1-4fce-ae37-036ab7eab224 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:06.589556 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-cfa574d2-40d1-4fce-ae37-036ab7eab224 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a641a08648b454780081ecc2e291066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a8451272cc41ebaf1598ed940bf09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:54:06.599082 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-cfa574d2-40d1-4fce-ae37-036ab7eab224 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/59dadfa9-df81-4e69-aa33-d99984dbebfc" status: 200 len: 1367 microversion: 2.1 time: 0.224240 May 12 14:54:06.600468 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 387/785] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:54:06 2022] GET /compute/v2.1/servers/59dadfa9-df81-4e69-aa33-d99984dbebfc => generated 1367 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:54:06.680851 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-3cde8f43-d165-4980-95d2-edef3ae571e4 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:54:06.681454 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-3cde8f43-d165-4980-95d2-edef3ae571e4 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: 5184e752-c944-4ecd-a516-600944c18dc1] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:54:06.721546 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-3cde8f43-d165-4980-95d2-edef3ae571e4 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:06.722088 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-3cde8f43-d165-4980-95d2-edef3ae571e4 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:06.723683 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-3cde8f43-d165-4980-95d2-edef3ae571e4 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:06.724363 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-3cde8f43-d165-4980-95d2-edef3ae571e4 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:06.792831 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [req-369ff4f4-522b-4452-ad08-86633a265871 req-7daebef2-2c74-410e-9161-4bc62a48c3a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12704ca3-a417-4cab-9a2c-98b9275218eb", "name": "network-vif-plugged", "status": "completed", "tag": "b2d377be-5a49-46c3-8536-f69f3d36a7e9"}]} {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:54:06.803150 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:54:06.803150 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: warnings.warn(msg) May 12 14:54:06.812563 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [req-369ff4f4-522b-4452-ad08-86633a265871 req-7daebef2-2c74-410e-9161-4bc62a48c3a6 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:06.813261 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [req-369ff4f4-522b-4452-ad08-86633a265871 req-7daebef2-2c74-410e-9161-4bc62a48c3a6 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:06.832573 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.compute.server_external_events [req-369ff4f4-522b-4452-ad08-86633a265871 req-7daebef2-2c74-410e-9161-4bc62a48c3a6 service nova] Creating event network-vif-plugged:b2d377be-5a49-46c3-8536-f69f3d36a7e9 for instance 12704ca3-a417-4cab-9a2c-98b9275218eb on hv-cinder-83118 May 12 14:54:06.837449 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [req-369ff4f4-522b-4452-ad08-86633a265871 req-7daebef2-2c74-410e-9161-4bc62a48c3a6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051300 May 12 14:54:06.838110 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 388/786] 10.222.0.49 () {64 vars in 1317 bytes} [Thu May 12 14:54:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:54:06.843093 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-dcde6eed-9604-423a-a738-a441e5f68ec2 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:54:06.843780 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-dcde6eed-9604-423a-a738-a441e5f68ec2 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] [instance: 12704ca3-a417-4cab-9a2c-98b9275218eb] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:54:06.851319 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-dcde6eed-9604-423a-a738-a441e5f68ec2 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:06.851796 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-dcde6eed-9604-423a-a738-a441e5f68ec2 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:06.852573 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-dcde6eed-9604-423a-a738-a441e5f68ec2 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:06.853013 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-dcde6eed-9604-423a-a738-a441e5f68ec2 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:06.937741 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-3cde8f43-d165-4980-95d2-edef3ae571e4 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:54:06.947409 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-3cde8f43-d165-4980-95d2-edef3ae571e4 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:54:06.948945 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-3cde8f43-d165-4980-95d2-edef3ae571e4 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:54:06.950029 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-3cde8f43-d165-4980-95d2-edef3ae571e4 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1" status: 200 len: 1408 microversion: 2.20 time: 0.285598 May 12 14:54:06.950923 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 399/787] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:54:06 2022] GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1 => generated 1408 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:54:07.051681 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-d16b643e-ced2-4c3c-a5be-d4181eb9614d tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:54:07.052294 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-d16b643e-ced2-4c3c-a5be-d4181eb9614d tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] [instance: 7855c920-9df4-495a-9733-78fe42b1705d] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:54:07.059489 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-d16b643e-ced2-4c3c-a5be-d4181eb9614d tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:07.059817 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-dcde6eed-9604-423a-a738-a441e5f68ec2 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef8036bc3ad4725b3af2607ceb17c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235689d103ed4d0dbe7b78698395bd21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:54:07.064092 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-d16b643e-ced2-4c3c-a5be-d4181eb9614d tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:07.064092 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-d16b643e-ced2-4c3c-a5be-d4181eb9614d tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:07.064092 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-d16b643e-ced2-4c3c-a5be-d4181eb9614d tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:07.068961 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-dcde6eed-9604-423a-a738-a441e5f68ec2 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] 10.222.0.49 "GET /compute/v2.1/servers/12704ca3-a417-4cab-9a2c-98b9275218eb" status: 200 len: 1267 microversion: 2.1 time: 0.229687 May 12 14:54:07.069614 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 389/788] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:54:06 2022] GET /compute/v2.1/servers/12704ca3-a417-4cab-9a2c-98b9275218eb => generated 1267 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:54:07.257462 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-d16b643e-ced2-4c3c-a5be-d4181eb9614d tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6d3863350647cdb3091c1006d56c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfe8d8bce3f496d9162c7f9c8727273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:54:07.265728 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-d16b643e-ced2-4c3c-a5be-d4181eb9614d tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] 10.222.0.49 "GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d" status: 200 len: 1567 microversion: 2.1 time: 0.217873 May 12 14:54:07.266342 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 400/789] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:54:07 2022] GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d => generated 1567 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:54:07.616143 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-969a7e5b-a7c9-46f0-98b5-ccfcdc969163 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:54:07.616756 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-969a7e5b-a7c9-46f0-98b5-ccfcdc969163 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 59dadfa9-df81-4e69-aa33-d99984dbebfc] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:54:07.623920 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-969a7e5b-a7c9-46f0-98b5-ccfcdc969163 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:07.624366 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-969a7e5b-a7c9-46f0-98b5-ccfcdc969163 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:07.625126 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-969a7e5b-a7c9-46f0-98b5-ccfcdc969163 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:07.625561 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-969a7e5b-a7c9-46f0-98b5-ccfcdc969163 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:07.821755 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-969a7e5b-a7c9-46f0-98b5-ccfcdc969163 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a641a08648b454780081ecc2e291066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a8451272cc41ebaf1598ed940bf09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:54:07.829891 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-969a7e5b-a7c9-46f0-98b5-ccfcdc969163 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/59dadfa9-df81-4e69-aa33-d99984dbebfc" status: 200 len: 1367 microversion: 2.1 time: 0.218057 May 12 14:54:07.830449 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 390/790] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:54:07 2022] GET /compute/v2.1/servers/59dadfa9-df81-4e69-aa33-d99984dbebfc => generated 1367 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:54:07.968392 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-aa9d8d43-2193-4cee-bff7-9b162cb17ef0 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:54:07.968996 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-aa9d8d43-2193-4cee-bff7-9b162cb17ef0 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: 5184e752-c944-4ecd-a516-600944c18dc1] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:54:07.976827 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-aa9d8d43-2193-4cee-bff7-9b162cb17ef0 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:07.977272 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-aa9d8d43-2193-4cee-bff7-9b162cb17ef0 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:07.978028 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-aa9d8d43-2193-4cee-bff7-9b162cb17ef0 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:07.978456 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-aa9d8d43-2193-4cee-bff7-9b162cb17ef0 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:08.085623 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-b66ae54e-16d7-4e56-8f55-d1652ec46e16 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:54:08.086324 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-b66ae54e-16d7-4e56-8f55-d1652ec46e16 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] [instance: 12704ca3-a417-4cab-9a2c-98b9275218eb] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:54:08.093575 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-b66ae54e-16d7-4e56-8f55-d1652ec46e16 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:08.094055 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-b66ae54e-16d7-4e56-8f55-d1652ec46e16 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:08.094842 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-b66ae54e-16d7-4e56-8f55-d1652ec46e16 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:08.095288 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-b66ae54e-16d7-4e56-8f55-d1652ec46e16 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:08.179406 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-aa9d8d43-2193-4cee-bff7-9b162cb17ef0 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:54:08.188149 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-aa9d8d43-2193-4cee-bff7-9b162cb17ef0 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:54:08.189726 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-aa9d8d43-2193-4cee-bff7-9b162cb17ef0 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:54:08.190844 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-aa9d8d43-2193-4cee-bff7-9b162cb17ef0 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1" status: 200 len: 1408 microversion: 2.20 time: 0.226184 May 12 14:54:08.191791 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 401/791] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:54:07 2022] GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1 => generated 1408 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:54:08.282604 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-d9c3e2ec-a79f-4891-a335-b51d07d740d4 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:54:08.283303 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-d9c3e2ec-a79f-4891-a335-b51d07d740d4 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] [instance: 7855c920-9df4-495a-9733-78fe42b1705d] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:54:08.291593 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-d9c3e2ec-a79f-4891-a335-b51d07d740d4 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:08.292045 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-d9c3e2ec-a79f-4891-a335-b51d07d740d4 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:08.292835 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-d9c3e2ec-a79f-4891-a335-b51d07d740d4 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:08.293283 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-d9c3e2ec-a79f-4891-a335-b51d07d740d4 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:08.300661 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-b66ae54e-16d7-4e56-8f55-d1652ec46e16 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef8036bc3ad4725b3af2607ceb17c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235689d103ed4d0dbe7b78698395bd21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:54:08.309272 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-b66ae54e-16d7-4e56-8f55-d1652ec46e16 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] 10.222.0.49 "GET /compute/v2.1/servers/12704ca3-a417-4cab-9a2c-98b9275218eb" status: 200 len: 1267 microversion: 2.1 time: 0.227735 May 12 14:54:08.309851 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 391/792] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:54:08 2022] GET /compute/v2.1/servers/12704ca3-a417-4cab-9a2c-98b9275218eb => generated 1267 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:54:08.496437 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-d9c3e2ec-a79f-4891-a335-b51d07d740d4 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6d3863350647cdb3091c1006d56c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfe8d8bce3f496d9162c7f9c8727273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:54:08.505153 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-d9c3e2ec-a79f-4891-a335-b51d07d740d4 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] 10.222.0.49 "GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d" status: 200 len: 1567 microversion: 2.1 time: 0.226387 May 12 14:54:08.505712 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 402/793] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:54:08 2022] GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d => generated 1567 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:54:08.846755 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-4648b196-ed7e-436d-83ae-0e2f7755d2f9 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:54:08.850486 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-4648b196-ed7e-436d-83ae-0e2f7755d2f9 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 59dadfa9-df81-4e69-aa33-d99984dbebfc] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:54:08.851648 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [req-b3297928-d95e-4412-8285-ee0fb63afa64 req-f2965854-ba74-4c62-b525-26536df7cd43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59dadfa9-df81-4e69-aa33-d99984dbebfc", "name": "network-vif-plugged", "status": "completed", "tag": "00ee9d33-d084-4d18-b69d-a02dc7875eab"}]} {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:54:08.853463 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:54:08.853463 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: warnings.warn(msg) May 12 14:54:08.855250 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-4648b196-ed7e-436d-83ae-0e2f7755d2f9 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:08.855926 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-4648b196-ed7e-436d-83ae-0e2f7755d2f9 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:08.856708 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-4648b196-ed7e-436d-83ae-0e2f7755d2f9 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:08.857306 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-4648b196-ed7e-436d-83ae-0e2f7755d2f9 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:08.862387 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [req-b3297928-d95e-4412-8285-ee0fb63afa64 req-f2965854-ba74-4c62-b525-26536df7cd43 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:08.863644 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [req-b3297928-d95e-4412-8285-ee0fb63afa64 req-f2965854-ba74-4c62-b525-26536df7cd43 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:08.880745 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.compute.server_external_events [req-b3297928-d95e-4412-8285-ee0fb63afa64 req-f2965854-ba74-4c62-b525-26536df7cd43 service nova] Creating event network-vif-plugged:00ee9d33-d084-4d18-b69d-a02dc7875eab for instance 59dadfa9-df81-4e69-aa33-d99984dbebfc on hv-cinder-83118 May 12 14:54:08.885456 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [req-b3297928-d95e-4412-8285-ee0fb63afa64 req-f2965854-ba74-4c62-b525-26536df7cd43 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038074 May 12 14:54:08.886279 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 403/794] 10.222.0.49 () {64 vars in 1317 bytes} [Thu May 12 14:54:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 14:54:09.068124 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-4648b196-ed7e-436d-83ae-0e2f7755d2f9 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a641a08648b454780081ecc2e291066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a8451272cc41ebaf1598ed940bf09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:54:09.076705 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-4648b196-ed7e-436d-83ae-0e2f7755d2f9 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/59dadfa9-df81-4e69-aa33-d99984dbebfc" status: 200 len: 1367 microversion: 2.1 time: 0.233851 May 12 14:54:09.077278 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 392/795] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:54:08 2022] GET /compute/v2.1/servers/59dadfa9-df81-4e69-aa33-d99984dbebfc => generated 1367 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:54:09.151132 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-cfbe543b-ffb4-40ae-a7fe-021208ffe227 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:54:09.151725 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-cfbe543b-ffb4-40ae-a7fe-021208ffe227 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 2ce97f89-b3ca-43bc-95bb-fc748d173ed5] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:54:09.160015 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-cfbe543b-ffb4-40ae-a7fe-021208ffe227 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:09.160701 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-cfbe543b-ffb4-40ae-a7fe-021208ffe227 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:09.161783 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-cfbe543b-ffb4-40ae-a7fe-021208ffe227 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:09.162227 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-cfbe543b-ffb4-40ae-a7fe-021208ffe227 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:09.209995 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-e33f297c-d6be-498e-98e9-820ab36410c9 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:54:09.210603 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-e33f297c-d6be-498e-98e9-820ab36410c9 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: 5184e752-c944-4ecd-a516-600944c18dc1] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:54:09.218387 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-e33f297c-d6be-498e-98e9-820ab36410c9 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:09.219131 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-e33f297c-d6be-498e-98e9-820ab36410c9 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:09.219967 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-e33f297c-d6be-498e-98e9-820ab36410c9 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:09.220412 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-e33f297c-d6be-498e-98e9-820ab36410c9 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:09.243498 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-cfbe543b-ffb4-40ae-a7fe-021208ffe227 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 2ce97f89-b3ca-43bc-95bb-fc748d173ed5] Going to try to terminate instance {{(pid=102213) delete /opt/stack/nova/nova/compute/api.py:2562}} May 12 14:54:09.425082 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-e33f297c-d6be-498e-98e9-820ab36410c9 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:54:09.434398 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-e33f297c-d6be-498e-98e9-820ab36410c9 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:54:09.435949 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-e33f297c-d6be-498e-98e9-820ab36410c9 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:54:09.437006 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-e33f297c-d6be-498e-98e9-820ab36410c9 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1" status: 200 len: 1408 microversion: 2.20 time: 0.230993 May 12 14:54:09.444353 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 393/796] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:54:09 2022] GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1 => generated 1408 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:54:09.444353 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-e3d30ce9-06c6-4602-8a1d-966a3e658af0 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:54:09.444353 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-e3d30ce9-06c6-4602-8a1d-966a3e658af0 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] [instance: 12704ca3-a417-4cab-9a2c-98b9275218eb] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:54:09.449683 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-e3d30ce9-06c6-4602-8a1d-966a3e658af0 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:09.450090 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-e3d30ce9-06c6-4602-8a1d-966a3e658af0 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:09.450876 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-e3d30ce9-06c6-4602-8a1d-966a3e658af0 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:09.451306 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-e3d30ce9-06c6-4602-8a1d-966a3e658af0 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:09.708701 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-e3d30ce9-06c6-4602-8a1d-966a3e658af0 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef8036bc3ad4725b3af2607ceb17c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235689d103ed4d0dbe7b78698395bd21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:54:09.715254 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-cfbe543b-ffb4-40ae-a7fe-021208ffe227 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "DELETE /compute/v2.1/servers/2ce97f89-b3ca-43bc-95bb-fc748d173ed5" status: 204 len: 0 microversion: 2.1 time: 0.567940 May 12 14:54:09.715840 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 404/797] 10.222.0.49 () {58 vars in 1238 bytes} [Thu May 12 14:54:09 2022] DELETE /compute/v2.1/servers/2ce97f89-b3ca-43bc-95bb-fc748d173ed5 => generated 0 bytes in 570 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 14:54:09.716882 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-e3d30ce9-06c6-4602-8a1d-966a3e658af0 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] 10.222.0.49 "GET /compute/v2.1/servers/12704ca3-a417-4cab-9a2c-98b9275218eb" status: 200 len: 1455 microversion: 2.1 time: 0.278191 May 12 14:54:09.717848 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 394/798] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:54:09 2022] GET /compute/v2.1/servers/12704ca3-a417-4cab-9a2c-98b9275218eb => generated 1455 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:54:09.721136 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-1fe760e4-5485-49f5-8dc4-5fa8dbd3f200 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:54:09.721819 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-1fe760e4-5485-49f5-8dc4-5fa8dbd3f200 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] [instance: 7855c920-9df4-495a-9733-78fe42b1705d] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:54:09.729264 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-413d6b8a-cb5a-42cf-9462-aa6e835590ed tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:54:09.729881 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-413d6b8a-cb5a-42cf-9462-aa6e835590ed tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 2ce97f89-b3ca-43bc-95bb-fc748d173ed5] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:54:09.730172 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-1fe760e4-5485-49f5-8dc4-5fa8dbd3f200 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:09.730637 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-1fe760e4-5485-49f5-8dc4-5fa8dbd3f200 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:09.731590 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-1fe760e4-5485-49f5-8dc4-5fa8dbd3f200 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:09.732313 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-1fe760e4-5485-49f5-8dc4-5fa8dbd3f200 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:09.736972 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-413d6b8a-cb5a-42cf-9462-aa6e835590ed tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:09.737413 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-413d6b8a-cb5a-42cf-9462-aa6e835590ed tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:09.738181 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-413d6b8a-cb5a-42cf-9462-aa6e835590ed tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:09.738610 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-413d6b8a-cb5a-42cf-9462-aa6e835590ed tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:09.929288 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-1fe760e4-5485-49f5-8dc4-5fa8dbd3f200 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6d3863350647cdb3091c1006d56c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfe8d8bce3f496d9162c7f9c8727273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:54:09.937607 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-1fe760e4-5485-49f5-8dc4-5fa8dbd3f200 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] 10.222.0.49 "GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d" status: 200 len: 1567 microversion: 2.1 time: 0.220578 May 12 14:54:09.938157 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 405/799] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:54:09 2022] GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d => generated 1567 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:54:09.942930 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-4b81e80e-99db-4405-85b0-ecc1ada517ad tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:54:09.943532 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-4b81e80e-99db-4405-85b0-ecc1ada517ad tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] [instance: 12704ca3-a417-4cab-9a2c-98b9275218eb] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:54:09.950399 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-4b81e80e-99db-4405-85b0-ecc1ada517ad tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:09.950927 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-4b81e80e-99db-4405-85b0-ecc1ada517ad tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:09.951690 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-4b81e80e-99db-4405-85b0-ecc1ada517ad tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:09.952125 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-4b81e80e-99db-4405-85b0-ecc1ada517ad tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:10.148446 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-4b81e80e-99db-4405-85b0-ecc1ada517ad tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef8036bc3ad4725b3af2607ceb17c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235689d103ed4d0dbe7b78698395bd21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:54:10.156818 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-4b81e80e-99db-4405-85b0-ecc1ada517ad tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] 10.222.0.49 "GET /compute/v2.1/servers/12704ca3-a417-4cab-9a2c-98b9275218eb" status: 200 len: 1455 microversion: 2.1 time: 0.217698 May 12 14:54:10.165176 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 406/800] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:54:09 2022] GET /compute/v2.1/servers/12704ca3-a417-4cab-9a2c-98b9275218eb => generated 1455 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:54:10.165176 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-8375edaa-68e1-4fd7-9e9a-7562a7e5b937 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:54:10.165176 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-8375edaa-68e1-4fd7-9e9a-7562a7e5b937 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 59dadfa9-df81-4e69-aa33-d99984dbebfc] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:54:10.171501 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-413d6b8a-cb5a-42cf-9462-aa6e835590ed tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:54:10.179397 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-8375edaa-68e1-4fd7-9e9a-7562a7e5b937 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:10.179866 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-8375edaa-68e1-4fd7-9e9a-7562a7e5b937 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:10.180629 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-8375edaa-68e1-4fd7-9e9a-7562a7e5b937 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:10.181074 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-8375edaa-68e1-4fd7-9e9a-7562a7e5b937 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:10.181861 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-413d6b8a-cb5a-42cf-9462-aa6e835590ed tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/2ce97f89-b3ca-43bc-95bb-fc748d173ed5" status: 200 len: 1507 microversion: 2.1 time: 0.456062 May 12 14:54:10.191480 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 395/801] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:54:09 2022] GET /compute/v2.1/servers/2ce97f89-b3ca-43bc-95bb-fc748d173ed5 => generated 1507 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:54:10.380873 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-8375edaa-68e1-4fd7-9e9a-7562a7e5b937 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a641a08648b454780081ecc2e291066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a8451272cc41ebaf1598ed940bf09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:54:10.390044 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-8375edaa-68e1-4fd7-9e9a-7562a7e5b937 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/59dadfa9-df81-4e69-aa33-d99984dbebfc" status: 200 len: 1367 microversion: 2.1 time: 0.231637 May 12 14:54:10.390623 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 407/802] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:54:10 2022] GET /compute/v2.1/servers/59dadfa9-df81-4e69-aa33-d99984dbebfc => generated 1367 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:54:10.455244 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-d43ccb1c-d143-49cc-8a29-25808d49b6d7 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:54:10.455766 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-d43ccb1c-d143-49cc-8a29-25808d49b6d7 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: 5184e752-c944-4ecd-a516-600944c18dc1] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:54:10.463644 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-d43ccb1c-d143-49cc-8a29-25808d49b6d7 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:10.464097 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-d43ccb1c-d143-49cc-8a29-25808d49b6d7 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:10.464890 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-d43ccb1c-d143-49cc-8a29-25808d49b6d7 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:10.465330 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-d43ccb1c-d143-49cc-8a29-25808d49b6d7 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:10.664067 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-d43ccb1c-d143-49cc-8a29-25808d49b6d7 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:54:10.672922 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-d43ccb1c-d143-49cc-8a29-25808d49b6d7 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:54:10.674521 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-d43ccb1c-d143-49cc-8a29-25808d49b6d7 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:54:10.676421 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-d43ccb1c-d143-49cc-8a29-25808d49b6d7 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1" status: 200 len: 1408 microversion: 2.20 time: 0.225001 May 12 14:54:10.677243 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 396/803] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:54:10 2022] GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1 => generated 1408 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:54:10.900986 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [req-a030f8b4-3567-449d-982e-d7e33eda7eca req-6fcf0f31-7c0d-48ec-83f8-d89ffcd74017 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5184e752-c944-4ecd-a516-600944c18dc1", "name": "network-vif-plugged", "status": "completed", "tag": "74c60ae0-11dc-4a5e-afb9-11e124615006"}]} {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:54:10.903290 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:54:10.903290 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: warnings.warn(msg) May 12 14:54:10.913709 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [req-a030f8b4-3567-449d-982e-d7e33eda7eca req-6fcf0f31-7c0d-48ec-83f8-d89ffcd74017 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:10.914470 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [req-a030f8b4-3567-449d-982e-d7e33eda7eca req-6fcf0f31-7c0d-48ec-83f8-d89ffcd74017 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:10.933212 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.compute.server_external_events [req-a030f8b4-3567-449d-982e-d7e33eda7eca req-6fcf0f31-7c0d-48ec-83f8-d89ffcd74017 service nova] Creating event network-vif-plugged:74c60ae0-11dc-4a5e-afb9-11e124615006 for instance 5184e752-c944-4ecd-a516-600944c18dc1 on hv-cinder-83118 May 12 14:54:10.938157 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [req-a030f8b4-3567-449d-982e-d7e33eda7eca req-6fcf0f31-7c0d-48ec-83f8-d89ffcd74017 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041091 May 12 14:54:10.938982 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 408/804] 10.222.0.49 () {64 vars in 1317 bytes} [Thu May 12 14:54:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:54:10.954496 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-fd877cfc-e6de-4928-b473-fa85c253ec0a tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:54:10.955133 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-fd877cfc-e6de-4928-b473-fa85c253ec0a tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] [instance: 7855c920-9df4-495a-9733-78fe42b1705d] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:54:10.963038 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-fd877cfc-e6de-4928-b473-fa85c253ec0a tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:10.963491 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-fd877cfc-e6de-4928-b473-fa85c253ec0a tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:10.964257 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-fd877cfc-e6de-4928-b473-fa85c253ec0a tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:10.964701 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-fd877cfc-e6de-4928-b473-fa85c253ec0a tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:11.199766 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-e7a56491-17fe-4da3-bcc6-d32e2509b25d tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:54:11.201443 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-e7a56491-17fe-4da3-bcc6-d32e2509b25d tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 2ce97f89-b3ca-43bc-95bb-fc748d173ed5] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:54:11.210610 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e7a56491-17fe-4da3-bcc6-d32e2509b25d tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:11.210857 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e7a56491-17fe-4da3-bcc6-d32e2509b25d tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:11.212056 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e7a56491-17fe-4da3-bcc6-d32e2509b25d tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:11.212823 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e7a56491-17fe-4da3-bcc6-d32e2509b25d tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:11.244390 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-fd877cfc-e6de-4928-b473-fa85c253ec0a tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6d3863350647cdb3091c1006d56c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfe8d8bce3f496d9162c7f9c8727273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:54:11.252873 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-fd877cfc-e6de-4928-b473-fa85c253ec0a tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] 10.222.0.49 "GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d" status: 200 len: 1567 microversion: 2.1 time: 0.301943 May 12 14:54:11.253613 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 397/805] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:54:10 2022] GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d => generated 1567 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:54:11.407824 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-09574379-467e-4741-9cd0-c13889e9623d tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:54:11.408711 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-09574379-467e-4741-9cd0-c13889e9623d tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 59dadfa9-df81-4e69-aa33-d99984dbebfc] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:54:11.422946 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-09574379-467e-4741-9cd0-c13889e9623d tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:11.422946 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-09574379-467e-4741-9cd0-c13889e9623d tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:11.422946 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-09574379-467e-4741-9cd0-c13889e9623d tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:11.422946 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-09574379-467e-4741-9cd0-c13889e9623d tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:11.429870 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-e7a56491-17fe-4da3-bcc6-d32e2509b25d tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:54:11.455779 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-e7a56491-17fe-4da3-bcc6-d32e2509b25d tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/2ce97f89-b3ca-43bc-95bb-fc748d173ed5" status: 200 len: 1507 microversion: 2.1 time: 0.260204 May 12 14:54:11.457735 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 409/806] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:54:11 2022] GET /compute/v2.1/servers/2ce97f89-b3ca-43bc-95bb-fc748d173ed5 => generated 1507 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:54:11.694339 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-ca530164-71d9-49c8-a1df-3b42c2f524d5 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:54:11.695037 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-ca530164-71d9-49c8-a1df-3b42c2f524d5 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: 5184e752-c944-4ecd-a516-600944c18dc1] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:54:11.703052 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-ca530164-71d9-49c8-a1df-3b42c2f524d5 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:11.703638 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-ca530164-71d9-49c8-a1df-3b42c2f524d5 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:11.704421 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-ca530164-71d9-49c8-a1df-3b42c2f524d5 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:11.704905 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-ca530164-71d9-49c8-a1df-3b42c2f524d5 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:11.921970 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-ca530164-71d9-49c8-a1df-3b42c2f524d5 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:54:11.931565 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-ca530164-71d9-49c8-a1df-3b42c2f524d5 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:54:11.932966 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-ca530164-71d9-49c8-a1df-3b42c2f524d5 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:54:11.934066 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-ca530164-71d9-49c8-a1df-3b42c2f524d5 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1" status: 200 len: 1408 microversion: 2.20 time: 0.243592 May 12 14:54:11.934865 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 410/807] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:54:11 2022] GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1 => generated 1408 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 14:54:12.270386 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-e4734d23-e53a-483d-9876-121bc2570d3e tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:54:12.271205 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-e4734d23-e53a-483d-9876-121bc2570d3e tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] [instance: 7855c920-9df4-495a-9733-78fe42b1705d] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:54:12.281776 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e4734d23-e53a-483d-9876-121bc2570d3e tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:12.282567 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e4734d23-e53a-483d-9876-121bc2570d3e tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:12.283933 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e4734d23-e53a-483d-9876-121bc2570d3e tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:12.284562 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e4734d23-e53a-483d-9876-121bc2570d3e tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:12.314262 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-09574379-467e-4741-9cd0-c13889e9623d tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a641a08648b454780081ecc2e291066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a8451272cc41ebaf1598ed940bf09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:54:12.326975 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-09574379-467e-4741-9cd0-c13889e9623d tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/59dadfa9-df81-4e69-aa33-d99984dbebfc" status: 200 len: 1557 microversion: 2.1 time: 0.923068 May 12 14:54:12.329012 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 398/808] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:54:11 2022] GET /compute/v2.1/servers/59dadfa9-df81-4e69-aa33-d99984dbebfc => generated 1557 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:54:12.345101 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-53bfeb12-a512-4088-89ba-c39f16ad129a tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:54:12.345883 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-53bfeb12-a512-4088-89ba-c39f16ad129a tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 59dadfa9-df81-4e69-aa33-d99984dbebfc] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:54:12.353655 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-53bfeb12-a512-4088-89ba-c39f16ad129a tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:12.354454 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-53bfeb12-a512-4088-89ba-c39f16ad129a tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:12.355479 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-53bfeb12-a512-4088-89ba-c39f16ad129a tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:12.356194 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-53bfeb12-a512-4088-89ba-c39f16ad129a tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:12.516767 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-53bfeb12-a512-4088-89ba-c39f16ad129a tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/59dadfa9-df81-4e69-aa33-d99984dbebfc/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.175586 May 12 14:54:12.517359 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 399/809] 10.222.0.49 () {58 vars in 1274 bytes} [Thu May 12 14:54:12 2022] GET /compute/v2.1/servers/59dadfa9-df81-4e69-aa33-d99984dbebfc/os-interface => generated 284 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:54:12.522154 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-8bb30a45-b5a9-470c-a410-d6786787e6d9 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:54:12.522760 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-8bb30a45-b5a9-470c-a410-d6786787e6d9 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 2ce97f89-b3ca-43bc-95bb-fc748d173ed5] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:54:12.530665 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-8bb30a45-b5a9-470c-a410-d6786787e6d9 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:12.531165 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-8bb30a45-b5a9-470c-a410-d6786787e6d9 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:12.531963 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-8bb30a45-b5a9-470c-a410-d6786787e6d9 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:12.532401 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-8bb30a45-b5a9-470c-a410-d6786787e6d9 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:12.794726 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-e4734d23-e53a-483d-9876-121bc2570d3e tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6d3863350647cdb3091c1006d56c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfe8d8bce3f496d9162c7f9c8727273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:54:12.803844 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-e4734d23-e53a-483d-9876-121bc2570d3e tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] 10.222.0.49 "GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d" status: 200 len: 1567 microversion: 2.1 time: 0.537991 May 12 14:54:12.804417 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 411/810] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:54:12 2022] GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d => generated 1567 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:54:12.960579 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-9a993a59-ae70-41bb-a800-91ae0b498c6d tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:54:12.961510 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-9a993a59-ae70-41bb-a800-91ae0b498c6d tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: 5184e752-c944-4ecd-a516-600944c18dc1] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:54:12.975149 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-9a993a59-ae70-41bb-a800-91ae0b498c6d tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:12.975772 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-9a993a59-ae70-41bb-a800-91ae0b498c6d tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:12.977347 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-9a993a59-ae70-41bb-a800-91ae0b498c6d tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:12.977922 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-9a993a59-ae70-41bb-a800-91ae0b498c6d tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:13.219663 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-9a993a59-ae70-41bb-a800-91ae0b498c6d tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:54:13.229933 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-9a993a59-ae70-41bb-a800-91ae0b498c6d tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:54:13.231594 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-9a993a59-ae70-41bb-a800-91ae0b498c6d tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:54:13.233249 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-9a993a59-ae70-41bb-a800-91ae0b498c6d tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1" status: 200 len: 1408 microversion: 2.20 time: 0.284247 May 12 14:54:13.233466 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 412/811] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:54:12 2022] GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1 => generated 1408 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:54:13.237777 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [req-293da3d0-9298-4c01-b9e6-c7d2e837fb08 req-f2b2e4a4-1fea-4b61-87d7-e59dc4553cb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ce97f89-b3ca-43bc-95bb-fc748d173ed5", "name": "network-vif-deleted", "tag": "358fc7eb-4380-4c2b-b14e-ae8fe0eb56fb"}]} {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:54:13.239378 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:54:13.239378 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: warnings.warn(msg) May 12 14:54:13.248254 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [req-293da3d0-9298-4c01-b9e6-c7d2e837fb08 req-f2b2e4a4-1fea-4b61-87d7-e59dc4553cb6 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:13.248643 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [req-293da3d0-9298-4c01-b9e6-c7d2e837fb08 req-f2b2e4a4-1fea-4b61-87d7-e59dc4553cb6 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:13.264017 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.compute.server_external_events [req-293da3d0-9298-4c01-b9e6-c7d2e837fb08 req-f2b2e4a4-1fea-4b61-87d7-e59dc4553cb6 service nova] Creating event network-vif-deleted:358fc7eb-4380-4c2b-b14e-ae8fe0eb56fb for instance 2ce97f89-b3ca-43bc-95bb-fc748d173ed5 on hv-cinder-83118 May 12 14:54:13.269423 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [req-293da3d0-9298-4c01-b9e6-c7d2e837fb08 req-f2b2e4a4-1fea-4b61-87d7-e59dc4553cb6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034295 May 12 14:54:13.270015 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 413/812] 10.222.0.49 () {64 vars in 1317 bytes} [Thu May 12 14:54:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:54:13.449714 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-8bb30a45-b5a9-470c-a410-d6786787e6d9 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:54:13.459338 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-8bb30a45-b5a9-470c-a410-d6786787e6d9 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/2ce97f89-b3ca-43bc-95bb-fc748d173ed5" status: 200 len: 1507 microversion: 2.1 time: 0.940846 May 12 14:54:13.463434 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 400/813] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:54:12 2022] GET /compute/v2.1/servers/2ce97f89-b3ca-43bc-95bb-fc748d173ed5 => generated 1507 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:54:13.821978 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-9ba6efb1-b42b-468b-88f2-f8e9f39c7bed tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:54:13.822688 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-9ba6efb1-b42b-468b-88f2-f8e9f39c7bed tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] [instance: 7855c920-9df4-495a-9733-78fe42b1705d] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:54:13.834951 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-9ba6efb1-b42b-468b-88f2-f8e9f39c7bed tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:13.835658 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-9ba6efb1-b42b-468b-88f2-f8e9f39c7bed tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:13.836622 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-9ba6efb1-b42b-468b-88f2-f8e9f39c7bed tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:13.837115 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-9ba6efb1-b42b-468b-88f2-f8e9f39c7bed tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:14.053248 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-9ba6efb1-b42b-468b-88f2-f8e9f39c7bed tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6d3863350647cdb3091c1006d56c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfe8d8bce3f496d9162c7f9c8727273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:54:14.062001 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-9ba6efb1-b42b-468b-88f2-f8e9f39c7bed tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] 10.222.0.49 "GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d" status: 200 len: 1567 microversion: 2.1 time: 0.244249 May 12 14:54:14.062700 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 414/814] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:54:13 2022] GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d => generated 1567 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:54:14.251132 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-774f3bca-f54c-4430-be25-022894c84979 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:54:14.251736 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-774f3bca-f54c-4430-be25-022894c84979 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: 5184e752-c944-4ecd-a516-600944c18dc1] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:54:14.259697 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-774f3bca-f54c-4430-be25-022894c84979 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:14.260141 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-774f3bca-f54c-4430-be25-022894c84979 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:14.261111 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-774f3bca-f54c-4430-be25-022894c84979 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:14.261538 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-774f3bca-f54c-4430-be25-022894c84979 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:14.476484 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-8a1e768c-3d65-4213-9d9c-2cc91c57a8a9 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:54:14.477090 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-8a1e768c-3d65-4213-9d9c-2cc91c57a8a9 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 2ce97f89-b3ca-43bc-95bb-fc748d173ed5] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:54:14.484352 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-8a1e768c-3d65-4213-9d9c-2cc91c57a8a9 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:14.484821 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-8a1e768c-3d65-4213-9d9c-2cc91c57a8a9 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:14.485790 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-8a1e768c-3d65-4213-9d9c-2cc91c57a8a9 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:14.486225 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-8a1e768c-3d65-4213-9d9c-2cc91c57a8a9 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:14.555841 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-8a1e768c-3d65-4213-9d9c-2cc91c57a8a9 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:14.556762 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-8a1e768c-3d65-4213-9d9c-2cc91c57a8a9 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:14.556884 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.objects.instance [None req-8a1e768c-3d65-4213-9d9c-2cc91c57a8a9 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lazy-loading 'fault' on Instance uuid 2ce97f89-b3ca-43bc-95bb-fc748d173ed5 {{(pid=102213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 12 14:54:14.746532 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-8a1e768c-3d65-4213-9d9c-2cc91c57a8a9 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:54:14.754630 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-8a1e768c-3d65-4213-9d9c-2cc91c57a8a9 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/2ce97f89-b3ca-43bc-95bb-fc748d173ed5" status: 200 len: 1312 microversion: 2.1 time: 0.282319 May 12 14:54:14.755243 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 415/815] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:54:14 2022] GET /compute/v2.1/servers/2ce97f89-b3ca-43bc-95bb-fc748d173ed5 => generated 1312 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:54:14.899701 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-774f3bca-f54c-4430-be25-022894c84979 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:54:14.908272 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-774f3bca-f54c-4430-be25-022894c84979 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:54:14.910034 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-774f3bca-f54c-4430-be25-022894c84979 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:54:14.911186 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-774f3bca-f54c-4430-be25-022894c84979 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1" status: 200 len: 1599 microversion: 2.20 time: 0.663864 May 12 14:54:14.911742 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 401/816] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:54:14 2022] GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1 => generated 1599 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:54:14.929230 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-07512508-8bd0-48e5-a0c2-c5cacf87e479 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:54:14.930101 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-07512508-8bd0-48e5-a0c2-c5cacf87e479 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: 5184e752-c944-4ecd-a516-600944c18dc1] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:54:14.937466 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-07512508-8bd0-48e5-a0c2-c5cacf87e479 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:14.937910 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-07512508-8bd0-48e5-a0c2-c5cacf87e479 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:14.938682 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-07512508-8bd0-48e5-a0c2-c5cacf87e479 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:14.939153 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-07512508-8bd0-48e5-a0c2-c5cacf87e479 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:15.080049 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-392cfdb2-6436-4df1-a870-aa854b553312 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:54:15.080748 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-392cfdb2-6436-4df1-a870-aa854b553312 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] [instance: 7855c920-9df4-495a-9733-78fe42b1705d] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:54:15.085611 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-07512508-8bd0-48e5-a0c2-c5cacf87e479 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.160541 May 12 14:54:15.086545 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 416/817] 10.222.0.49 () {60 vars in 1315 bytes} [Thu May 12 14:54:14 2022] GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1/os-interface => generated 284 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 14:54:15.089076 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-392cfdb2-6436-4df1-a870-aa854b553312 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:15.089530 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-392cfdb2-6436-4df1-a870-aa854b553312 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:15.090350 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-392cfdb2-6436-4df1-a870-aa854b553312 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:15.091027 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-392cfdb2-6436-4df1-a870-aa854b553312 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:15.711968 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-392cfdb2-6436-4df1-a870-aa854b553312 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6d3863350647cdb3091c1006d56c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfe8d8bce3f496d9162c7f9c8727273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:54:15.723953 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-392cfdb2-6436-4df1-a870-aa854b553312 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] 10.222.0.49 "GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d" status: 200 len: 1567 microversion: 2.1 time: 0.647555 May 12 14:54:15.735106 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 402/818] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:54:15 2022] GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d => generated 1567 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:54:15.773616 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-e550a796-89b0-49c2-9221-e846c3915410 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:54:15.775090 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-e550a796-89b0-49c2-9221-e846c3915410 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: 2ce97f89-b3ca-43bc-95bb-fc748d173ed5] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:54:15.787192 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e550a796-89b0-49c2-9221-e846c3915410 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:15.788611 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e550a796-89b0-49c2-9221-e846c3915410 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:15.790188 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e550a796-89b0-49c2-9221-e846c3915410 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:15.790890 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e550a796-89b0-49c2-9221-e846c3915410 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:15.907761 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [req-66107a9e-ab92-438f-83c9-372fc279cb3c req-8b638a03-e2aa-482e-bafa-f04bf8c08111 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59dadfa9-df81-4e69-aa33-d99984dbebfc", "tag": "00ee9d33-d084-4d18-b69d-a02dc7875eab"}]} {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:54:15.910743 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:54:15.910743 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: warnings.warn(msg) May 12 14:54:15.921430 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.wsgi [None req-e550a796-89b0-49c2-9221-e846c3915410 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] HTTP exception thrown: Instance 2ce97f89-b3ca-43bc-95bb-fc748d173ed5 could not be found. May 12 14:54:15.921635 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [req-66107a9e-ab92-438f-83c9-372fc279cb3c req-8b638a03-e2aa-482e-bafa-f04bf8c08111 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:15.922053 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-e550a796-89b0-49c2-9221-e846c3915410 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Returning 404 to user: Instance 2ce97f89-b3ca-43bc-95bb-fc748d173ed5 could not be found. {{(pid=102213) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 12 14:54:15.923324 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-e550a796-89b0-49c2-9221-e846c3915410 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/2ce97f89-b3ca-43bc-95bb-fc748d173ed5" status: 404 len: 111 microversion: 2.1 time: 0.154998 May 12 14:54:15.923696 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [req-66107a9e-ab92-438f-83c9-372fc279cb3c req-8b638a03-e2aa-482e-bafa-f04bf8c08111 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:15.929600 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 417/819] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:54:15 2022] GET /compute/v2.1/servers/2ce97f89-b3ca-43bc-95bb-fc748d173ed5 => generated 111 bytes in 162 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 14:54:15.938240 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-07ba88a9-414b-4228-84ec-8c52e9c7b0e6 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:54:15.938823 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-07ba88a9-414b-4228-84ec-8c52e9c7b0e6 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:54:15.946760 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-07ba88a9-414b-4228-84ec-8c52e9c7b0e6 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:15.947355 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-07ba88a9-414b-4228-84ec-8c52e9c7b0e6 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:15.948198 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-07ba88a9-414b-4228-84ec-8c52e9c7b0e6 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:15.948638 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-07ba88a9-414b-4228-84ec-8c52e9c7b0e6 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:15.961323 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.compute.server_external_events [req-66107a9e-ab92-438f-83c9-372fc279cb3c req-8b638a03-e2aa-482e-bafa-f04bf8c08111 service nova] Creating event network-changed:00ee9d33-d084-4d18-b69d-a02dc7875eab for instance 59dadfa9-df81-4e69-aa33-d99984dbebfc on hv-cinder-83118 May 12 14:54:15.971820 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [req-66107a9e-ab92-438f-83c9-372fc279cb3c req-8b638a03-e2aa-482e-bafa-f04bf8c08111 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064702 May 12 14:54:15.973576 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 403/820] 10.222.0.49 () {64 vars in 1317 bytes} [Thu May 12 14:54:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 14:54:16.020986 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-07ba88a9-414b-4228-84ec-8c52e9c7b0e6 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1] Going to try to terminate instance {{(pid=102213) delete /opt/stack/nova/nova/compute/api.py:2562}} May 12 14:54:16.407113 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-07ba88a9-414b-4228-84ec-8c52e9c7b0e6 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "DELETE /compute/v2.1/servers/d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1" status: 204 len: 0 microversion: 2.1 time: 0.475492 May 12 14:54:16.407999 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 418/821] 10.222.0.49 () {58 vars in 1238 bytes} [Thu May 12 14:54:15 2022] DELETE /compute/v2.1/servers/d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 14:54:16.417414 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-d8a5f6c3-fe94-4992-a890-578f21b5e29d tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:54:16.418413 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-d8a5f6c3-fe94-4992-a890-578f21b5e29d tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:54:16.434828 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-d8a5f6c3-fe94-4992-a890-578f21b5e29d tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:16.437612 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-d8a5f6c3-fe94-4992-a890-578f21b5e29d tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:16.437612 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-d8a5f6c3-fe94-4992-a890-578f21b5e29d tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:16.437612 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-d8a5f6c3-fe94-4992-a890-578f21b5e29d tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:16.742277 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-13ece326-800c-473d-b365-75888fb595a3 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:54:16.743092 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-13ece326-800c-473d-b365-75888fb595a3 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] [instance: 7855c920-9df4-495a-9733-78fe42b1705d] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:54:16.758046 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-13ece326-800c-473d-b365-75888fb595a3 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:16.758581 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-13ece326-800c-473d-b365-75888fb595a3 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:16.759446 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-13ece326-800c-473d-b365-75888fb595a3 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:16.759887 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-13ece326-800c-473d-b365-75888fb595a3 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:17.000291 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-d8a5f6c3-fe94-4992-a890-578f21b5e29d tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:54:17.014609 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-d8a5f6c3-fe94-4992-a890-578f21b5e29d tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1" status: 200 len: 1521 microversion: 2.1 time: 0.601365 May 12 14:54:17.019746 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 404/822] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:54:16 2022] GET /compute/v2.1/servers/d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1 => generated 1521 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:54:17.024522 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [req-6ae199cd-2829-41e9-b049-ce01c8a6a58d req-e13a9cc3-143d-491f-8cd8-a84c633c00ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7855c920-9df4-495a-9733-78fe42b1705d", "name": "network-vif-unplugged", "status": "completed", "tag": "71d6ba38-f010-4812-ade3-cd0173c05466"}]} {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:54:17.031765 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:54:17.031765 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: warnings.warn(msg) May 12 14:54:17.059704 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [req-6ae199cd-2829-41e9-b049-ce01c8a6a58d req-e13a9cc3-143d-491f-8cd8-a84c633c00ba service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:17.060261 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [req-6ae199cd-2829-41e9-b049-ce01c8a6a58d req-e13a9cc3-143d-491f-8cd8-a84c633c00ba service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:17.085729 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.compute.server_external_events [req-6ae199cd-2829-41e9-b049-ce01c8a6a58d req-e13a9cc3-143d-491f-8cd8-a84c633c00ba service nova] Creating event network-vif-unplugged:71d6ba38-f010-4812-ade3-cd0173c05466 for instance 7855c920-9df4-495a-9733-78fe42b1705d on hv-cinder-83118 May 12 14:54:17.094939 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [req-6ae199cd-2829-41e9-b049-ce01c8a6a58d req-e13a9cc3-143d-491f-8cd8-a84c633c00ba service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.074068 May 12 14:54:17.095645 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 405/823] 10.222.0.49 () {64 vars in 1317 bytes} [Thu May 12 14:54:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:54:17.295087 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [req-aad25b99-03cc-4a8d-aa47-4debb485caa0 req-08393297-f7c6-45d1-9e88-f0b2866fdb12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5184e752-c944-4ecd-a516-600944c18dc1", "tag": "74c60ae0-11dc-4a5e-afb9-11e124615006"}]} {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:54:17.296747 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:54:17.296747 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: warnings.warn(msg) May 12 14:54:17.332557 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [req-aad25b99-03cc-4a8d-aa47-4debb485caa0 req-08393297-f7c6-45d1-9e88-f0b2866fdb12 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:17.332927 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [req-aad25b99-03cc-4a8d-aa47-4debb485caa0 req-08393297-f7c6-45d1-9e88-f0b2866fdb12 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:17.361794 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.compute.server_external_events [req-aad25b99-03cc-4a8d-aa47-4debb485caa0 req-08393297-f7c6-45d1-9e88-f0b2866fdb12 service nova] Creating event network-changed:74c60ae0-11dc-4a5e-afb9-11e124615006 for instance 5184e752-c944-4ecd-a516-600944c18dc1 on hv-cinder-83118 May 12 14:54:17.379466 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [req-aad25b99-03cc-4a8d-aa47-4debb485caa0 req-08393297-f7c6-45d1-9e88-f0b2866fdb12 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088339 May 12 14:54:17.385062 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 406/824] 10.222.0.49 () {64 vars in 1317 bytes} [Thu May 12 14:54:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:54:17.394931 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-13ece326-800c-473d-b365-75888fb595a3 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6d3863350647cdb3091c1006d56c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfe8d8bce3f496d9162c7f9c8727273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:54:17.403419 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-13ece326-800c-473d-b365-75888fb595a3 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] 10.222.0.49 "GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d" status: 200 len: 1567 microversion: 2.1 time: 0.665493 May 12 14:54:17.404249 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 419/825] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:54:16 2022] GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d => generated 1567 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:54:17.988514 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [req-0e3c22c1-b2c0-48b5-a21f-a2728fba1a1c req-2f07379f-1148-4d04-b130-3c2854a716e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12704ca3-a417-4cab-9a2c-98b9275218eb", "tag": "b2d377be-5a49-46c3-8536-f69f3d36a7e9"}]} {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:54:17.989976 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:54:17.989976 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: warnings.warn(msg) May 12 14:54:17.998413 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [req-0e3c22c1-b2c0-48b5-a21f-a2728fba1a1c req-2f07379f-1148-4d04-b130-3c2854a716e3 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:17.999219 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [req-0e3c22c1-b2c0-48b5-a21f-a2728fba1a1c req-2f07379f-1148-4d04-b130-3c2854a716e3 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:18.015732 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.compute.server_external_events [req-0e3c22c1-b2c0-48b5-a21f-a2728fba1a1c req-2f07379f-1148-4d04-b130-3c2854a716e3 service nova] Creating event network-changed:b2d377be-5a49-46c3-8536-f69f3d36a7e9 for instance 12704ca3-a417-4cab-9a2c-98b9275218eb on hv-cinder-83118 May 12 14:54:18.021954 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [req-0e3c22c1-b2c0-48b5-a21f-a2728fba1a1c req-2f07379f-1148-4d04-b130-3c2854a716e3 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037386 May 12 14:54:18.022913 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 407/826] 10.222.0.49 () {64 vars in 1317 bytes} [Thu May 12 14:54:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:54:18.037231 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-e1279e2f-27d3-4b9d-b107-d222af908391 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:54:18.038001 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-e1279e2f-27d3-4b9d-b107-d222af908391 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:54:18.045747 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e1279e2f-27d3-4b9d-b107-d222af908391 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:18.046278 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e1279e2f-27d3-4b9d-b107-d222af908391 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:18.047209 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e1279e2f-27d3-4b9d-b107-d222af908391 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:18.047699 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e1279e2f-27d3-4b9d-b107-d222af908391 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:18.428975 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-a450e347-a08f-4124-b9de-d0de6ffd3e1d tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:54:18.428975 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-a450e347-a08f-4124-b9de-d0de6ffd3e1d tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] [instance: 7855c920-9df4-495a-9733-78fe42b1705d] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:54:18.433839 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-e1279e2f-27d3-4b9d-b107-d222af908391 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:54:18.447028 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-e1279e2f-27d3-4b9d-b107-d222af908391 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1" status: 200 len: 1521 microversion: 2.1 time: 0.414085 May 12 14:54:18.449792 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 420/827] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:54:18 2022] GET /compute/v2.1/servers/d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1 => generated 1521 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:54:18.451335 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-a450e347-a08f-4124-b9de-d0de6ffd3e1d tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:18.452374 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-a450e347-a08f-4124-b9de-d0de6ffd3e1d tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:18.453868 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-a450e347-a08f-4124-b9de-d0de6ffd3e1d tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:18.454644 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-a450e347-a08f-4124-b9de-d0de6ffd3e1d tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:18.704938 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-a450e347-a08f-4124-b9de-d0de6ffd3e1d tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6d3863350647cdb3091c1006d56c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfe8d8bce3f496d9162c7f9c8727273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:54:18.720302 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-a450e347-a08f-4124-b9de-d0de6ffd3e1d tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] 10.222.0.49 "GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d" status: 200 len: 1508 microversion: 2.1 time: 0.302439 May 12 14:54:18.721721 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 408/828] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:54:18 2022] GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d => generated 1508 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:54:18.737673 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-d6ff018d-d8f5-4689-8910-3c8f31eb8cbf tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:54:18.738245 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-d6ff018d-d8f5-4689-8910-3c8f31eb8cbf tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] [instance: 7855c920-9df4-495a-9733-78fe42b1705d] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:54:18.748479 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-d6ff018d-d8f5-4689-8910-3c8f31eb8cbf tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:18.748479 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-d6ff018d-d8f5-4689-8910-3c8f31eb8cbf tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:18.748986 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-d6ff018d-d8f5-4689-8910-3c8f31eb8cbf tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:18.749946 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-d6ff018d-d8f5-4689-8910-3c8f31eb8cbf tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:19.208212 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-d6ff018d-d8f5-4689-8910-3c8f31eb8cbf tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] 10.222.0.49 "POST /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d/action" status: 202 len: 0 microversion: 2.1 time: 0.474255 May 12 14:54:19.212233 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 421/829] 10.222.0.49 () {60 vars in 1277 bytes} [Thu May 12 14:54:18 2022] POST /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d/action => generated 0 bytes in 476 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 14:54:19.219547 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-8c48fb61-667e-4066-8d53-8b60bf6dfe34 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:54:19.221363 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-8c48fb61-667e-4066-8d53-8b60bf6dfe34 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] [instance: 7855c920-9df4-495a-9733-78fe42b1705d] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:54:19.230048 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-8c48fb61-667e-4066-8d53-8b60bf6dfe34 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:19.230796 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-8c48fb61-667e-4066-8d53-8b60bf6dfe34 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:19.231775 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-8c48fb61-667e-4066-8d53-8b60bf6dfe34 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:19.233084 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-8c48fb61-667e-4066-8d53-8b60bf6dfe34 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:19.473621 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-0f3bf7bc-2639-4dac-93bc-f8ba81aff312 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:54:19.475249 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-0f3bf7bc-2639-4dac-93bc-f8ba81aff312 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:54:19.502884 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-0f3bf7bc-2639-4dac-93bc-f8ba81aff312 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:19.502884 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-0f3bf7bc-2639-4dac-93bc-f8ba81aff312 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:19.502884 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-0f3bf7bc-2639-4dac-93bc-f8ba81aff312 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:19.502884 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-0f3bf7bc-2639-4dac-93bc-f8ba81aff312 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:19.754897 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-0f3bf7bc-2639-4dac-93bc-f8ba81aff312 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:54:19.763688 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-0f3bf7bc-2639-4dac-93bc-f8ba81aff312 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1" status: 200 len: 1521 microversion: 2.1 time: 0.294034 May 12 14:54:19.764263 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 422/830] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:54:19 2022] GET /compute/v2.1/servers/d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1 => generated 1521 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:54:19.867205 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-8c48fb61-667e-4066-8d53-8b60bf6dfe34 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6d3863350647cdb3091c1006d56c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfe8d8bce3f496d9162c7f9c8727273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:54:19.879650 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-8c48fb61-667e-4066-8d53-8b60bf6dfe34 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] 10.222.0.49 "GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d" status: 200 len: 1516 microversion: 2.1 time: 0.665698 May 12 14:54:19.881399 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 409/831] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:54:19 2022] GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d => generated 1516 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:54:20.483309 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [req-eeeafa40-2bdd-46f2-92f5-06c38b856136 req-9712a4f9-14ac-4dcd-b936-11b709df154d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1", "name": "network-vif-deleted", "tag": "e6f62ab3-f3da-45c1-adb2-4c7f5c9d2ff4"}]} {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:54:20.485157 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:54:20.485157 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: warnings.warn(msg) May 12 14:54:20.497011 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [req-eeeafa40-2bdd-46f2-92f5-06c38b856136 req-9712a4f9-14ac-4dcd-b936-11b709df154d service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:20.497455 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [req-eeeafa40-2bdd-46f2-92f5-06c38b856136 req-9712a4f9-14ac-4dcd-b936-11b709df154d service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:20.513687 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.compute.server_external_events [req-eeeafa40-2bdd-46f2-92f5-06c38b856136 req-9712a4f9-14ac-4dcd-b936-11b709df154d service nova] Creating event network-vif-deleted:e6f62ab3-f3da-45c1-adb2-4c7f5c9d2ff4 for instance d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1 on hv-cinder-83118 May 12 14:54:20.518795 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [req-eeeafa40-2bdd-46f2-92f5-06c38b856136 req-9712a4f9-14ac-4dcd-b936-11b709df154d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039059 May 12 14:54:20.522021 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 423/832] 10.222.0.49 () {64 vars in 1317 bytes} [Thu May 12 14:54:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:54:20.780735 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-a4988a3f-14a8-4400-9326-b6a4e1efe936 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:54:20.781538 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-a4988a3f-14a8-4400-9326-b6a4e1efe936 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:54:20.789810 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-a4988a3f-14a8-4400-9326-b6a4e1efe936 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:20.790391 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-a4988a3f-14a8-4400-9326-b6a4e1efe936 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:20.791214 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-a4988a3f-14a8-4400-9326-b6a4e1efe936 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:20.791656 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-a4988a3f-14a8-4400-9326-b6a4e1efe936 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:20.897910 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-5bd5d227-9cf2-499d-b398-dfeef07804b5 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:54:20.898616 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-5bd5d227-9cf2-499d-b398-dfeef07804b5 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] [instance: 7855c920-9df4-495a-9733-78fe42b1705d] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:54:20.906321 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-5bd5d227-9cf2-499d-b398-dfeef07804b5 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:20.906772 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-5bd5d227-9cf2-499d-b398-dfeef07804b5 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:20.907753 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-5bd5d227-9cf2-499d-b398-dfeef07804b5 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:20.908185 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-5bd5d227-9cf2-499d-b398-dfeef07804b5 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:21.067292 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-a4988a3f-14a8-4400-9326-b6a4e1efe936 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccce5e3f8320498ea48fa16c7d811ee1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0301badcd92e4cc483246a0fa4949060', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:54:21.076776 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-a4988a3f-14a8-4400-9326-b6a4e1efe936 tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1" status: 200 len: 1307 microversion: 2.1 time: 0.299656 May 12 14:54:21.085986 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 410/833] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:54:20 2022] GET /compute/v2.1/servers/d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1 => generated 1307 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:54:21.103821 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-5bd5d227-9cf2-499d-b398-dfeef07804b5 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6d3863350647cdb3091c1006d56c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfe8d8bce3f496d9162c7f9c8727273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:54:21.112350 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-5bd5d227-9cf2-499d-b398-dfeef07804b5 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] 10.222.0.49 "GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d" status: 200 len: 1516 microversion: 2.1 time: 0.218619 May 12 14:54:21.114954 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 424/834] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:54:20 2022] GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d => generated 1516 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:54:22.093621 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-bd8e1ae7-ac9c-4871-b800-8d09328accfd tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:54:22.094179 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-bd8e1ae7-ac9c-4871-b800-8d09328accfd tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] [instance: d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:54:22.101283 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-bd8e1ae7-ac9c-4871-b800-8d09328accfd tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:22.101738 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-bd8e1ae7-ac9c-4871-b800-8d09328accfd tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:22.102492 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-bd8e1ae7-ac9c-4871-b800-8d09328accfd tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:22.102958 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-bd8e1ae7-ac9c-4871-b800-8d09328accfd tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:22.129738 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-b64d49ed-2243-495f-9f1c-0a7adaa0ce71 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:54:22.130501 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-b64d49ed-2243-495f-9f1c-0a7adaa0ce71 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] [instance: 7855c920-9df4-495a-9733-78fe42b1705d] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:54:22.137642 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-b64d49ed-2243-495f-9f1c-0a7adaa0ce71 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:22.141898 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-b64d49ed-2243-495f-9f1c-0a7adaa0ce71 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:22.141898 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-b64d49ed-2243-495f-9f1c-0a7adaa0ce71 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:22.141898 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-b64d49ed-2243-495f-9f1c-0a7adaa0ce71 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:22.155270 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.wsgi [None req-bd8e1ae7-ac9c-4871-b800-8d09328accfd tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] HTTP exception thrown: Instance d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1 could not be found. May 12 14:54:22.155873 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-bd8e1ae7-ac9c-4871-b800-8d09328accfd tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] Returning 404 to user: Instance d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1 could not be found. {{(pid=102212) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 12 14:54:22.156696 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-bd8e1ae7-ac9c-4871-b800-8d09328accfd tempest-ServerRescueNegativeTestJSON-2113956476 tempest-ServerRescueNegativeTestJSON-2113956476-project] 10.222.0.49 "GET /compute/v2.1/servers/d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1" status: 404 len: 111 microversion: 2.1 time: 0.067003 May 12 14:54:22.157652 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 411/835] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:54:22 2022] GET /compute/v2.1/servers/d2a37fa3-19e4-4b7e-adfc-a28ec8493ba1 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 14:54:22.358516 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-b64d49ed-2243-495f-9f1c-0a7adaa0ce71 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6d3863350647cdb3091c1006d56c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfe8d8bce3f496d9162c7f9c8727273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:54:22.367627 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-b64d49ed-2243-495f-9f1c-0a7adaa0ce71 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] 10.222.0.49 "GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d" status: 200 len: 1518 microversion: 2.1 time: 0.242067 May 12 14:54:22.368211 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 425/836] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:54:22 2022] GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d => generated 1518 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:54:23.338336 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-31ed1c4c-4cb1-4911-b726-e93487942260 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:54:23.339471 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-31ed1c4c-4cb1-4911-b726-e93487942260 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 358a3c59-ec18-40a6-b2a2-d7a37b46d08f] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:54:23.347573 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-31ed1c4c-4cb1-4911-b726-e93487942260 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:23.348053 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-31ed1c4c-4cb1-4911-b726-e93487942260 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:23.348811 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-31ed1c4c-4cb1-4911-b726-e93487942260 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:23.349253 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-31ed1c4c-4cb1-4911-b726-e93487942260 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:23.385292 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-a1269a57-9121-4b18-8c26-a8e5bbdd344b tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:54:23.385903 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-a1269a57-9121-4b18-8c26-a8e5bbdd344b tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] [instance: 7855c920-9df4-495a-9733-78fe42b1705d] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:54:23.393343 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-a1269a57-9121-4b18-8c26-a8e5bbdd344b tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:23.394347 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-a1269a57-9121-4b18-8c26-a8e5bbdd344b tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:23.395158 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-a1269a57-9121-4b18-8c26-a8e5bbdd344b tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:23.395592 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-a1269a57-9121-4b18-8c26-a8e5bbdd344b tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:23.412095 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-31ed1c4c-4cb1-4911-b726-e93487942260 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "GET /compute/v2.1/servers/358a3c59-ec18-40a6-b2a2-d7a37b46d08f/ips" status: 200 len: 145 microversion: 2.1 time: 0.077590 May 12 14:54:23.417541 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 412/837] 10.222.0.49 () {58 vars in 1247 bytes} [Thu May 12 14:54:23 2022] GET /compute/v2.1/servers/358a3c59-ec18-40a6-b2a2-d7a37b46d08f/ips => generated 145 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:54:23.601471 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-a1269a57-9121-4b18-8c26-a8e5bbdd344b tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6d3863350647cdb3091c1006d56c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfe8d8bce3f496d9162c7f9c8727273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:54:23.610108 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-a1269a57-9121-4b18-8c26-a8e5bbdd344b tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] 10.222.0.49 "GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d" status: 200 len: 1574 microversion: 2.1 time: 0.228447 May 12 14:54:23.610671 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 426/838] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:54:23 2022] GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d => generated 1574 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:54:24.627167 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-c817d312-89f8-4c23-aa51-7821d01569d1 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:54:24.627887 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-c817d312-89f8-4c23-aa51-7821d01569d1 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] [instance: 7855c920-9df4-495a-9733-78fe42b1705d] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:54:24.635363 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-c817d312-89f8-4c23-aa51-7821d01569d1 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:24.635813 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-c817d312-89f8-4c23-aa51-7821d01569d1 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:24.636596 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-c817d312-89f8-4c23-aa51-7821d01569d1 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:24.637031 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-c817d312-89f8-4c23-aa51-7821d01569d1 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:25.194453 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-c817d312-89f8-4c23-aa51-7821d01569d1 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6d3863350647cdb3091c1006d56c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfe8d8bce3f496d9162c7f9c8727273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:54:25.203317 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-c817d312-89f8-4c23-aa51-7821d01569d1 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] 10.222.0.49 "GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d" status: 200 len: 1574 microversion: 2.1 time: 0.579973 May 12 14:54:25.204081 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 413/839] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:54:24 2022] GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d => generated 1574 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:54:25.467705 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-1cdeb973-c399-4769-afa9-27505187177a tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "207a565d-f61a-46ec-9330-eeea20c5a1af"}} {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:54:25.471133 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-1cdeb973-c399-4769-afa9-27505187177a tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 358a3c59-ec18-40a6-b2a2-d7a37b46d08f] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:54:25.476073 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-1cdeb973-c399-4769-afa9-27505187177a tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:25.476530 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-1cdeb973-c399-4769-afa9-27505187177a tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:25.477321 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-1cdeb973-c399-4769-afa9-27505187177a tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:25.477755 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-1cdeb973-c399-4769-afa9-27505187177a tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:26.220362 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-3fc7eca5-2146-426b-ad6a-eb543a2c8857 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:54:26.221701 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-3fc7eca5-2146-426b-ad6a-eb543a2c8857 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] [instance: 7855c920-9df4-495a-9733-78fe42b1705d] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:54:26.230649 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-3fc7eca5-2146-426b-ad6a-eb543a2c8857 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:26.231358 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-3fc7eca5-2146-426b-ad6a-eb543a2c8857 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:26.232402 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-3fc7eca5-2146-426b-ad6a-eb543a2c8857 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:26.233052 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-3fc7eca5-2146-426b-ad6a-eb543a2c8857 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:26.459293 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-3fc7eca5-2146-426b-ad6a-eb543a2c8857 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6d3863350647cdb3091c1006d56c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfe8d8bce3f496d9162c7f9c8727273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:54:26.468579 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-3fc7eca5-2146-426b-ad6a-eb543a2c8857 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] 10.222.0.49 "GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d" status: 200 len: 1574 microversion: 2.1 time: 0.251752 May 12 14:54:26.469143 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 414/840] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:54:26 2022] GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d => generated 1574 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:54:26.580565 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-1cdeb973-c399-4769-afa9-27505187177a tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "POST /compute/v2.1/servers/358a3c59-ec18-40a6-b2a2-d7a37b46d08f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.116399 May 12 14:54:26.583969 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 427/841] 10.222.0.49 () {60 vars in 1322 bytes} [Thu May 12 14:54:25 2022] POST /compute/v2.1/servers/358a3c59-ec18-40a6-b2a2-d7a37b46d08f/os-volume_attachments => generated 194 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:54:27.485529 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-9b317414-b707-4ef2-be7c-74ef01ebbd2f tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:54:27.486141 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-9b317414-b707-4ef2-be7c-74ef01ebbd2f tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] [instance: 7855c920-9df4-495a-9733-78fe42b1705d] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:54:27.493720 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-9b317414-b707-4ef2-be7c-74ef01ebbd2f tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:27.494200 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-9b317414-b707-4ef2-be7c-74ef01ebbd2f tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:27.495008 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-9b317414-b707-4ef2-be7c-74ef01ebbd2f tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:27.495442 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-9b317414-b707-4ef2-be7c-74ef01ebbd2f tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:27.953436 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-9b317414-b707-4ef2-be7c-74ef01ebbd2f tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6d3863350647cdb3091c1006d56c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfe8d8bce3f496d9162c7f9c8727273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:54:27.966446 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-9b317414-b707-4ef2-be7c-74ef01ebbd2f tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] 10.222.0.49 "GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d" status: 200 len: 1574 microversion: 2.1 time: 0.484493 May 12 14:54:27.976184 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 415/842] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:54:27 2022] GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d => generated 1574 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:54:28.983581 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-a8aef192-8236-49b7-ba80-d2da99b8bb32 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:54:28.984401 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-a8aef192-8236-49b7-ba80-d2da99b8bb32 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] [instance: 7855c920-9df4-495a-9733-78fe42b1705d] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:54:28.992784 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-a8aef192-8236-49b7-ba80-d2da99b8bb32 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:28.993226 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-a8aef192-8236-49b7-ba80-d2da99b8bb32 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:28.993989 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-a8aef192-8236-49b7-ba80-d2da99b8bb32 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:28.994545 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-a8aef192-8236-49b7-ba80-d2da99b8bb32 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:29.397340 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-a8aef192-8236-49b7-ba80-d2da99b8bb32 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6d3863350647cdb3091c1006d56c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfe8d8bce3f496d9162c7f9c8727273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:54:29.405744 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-a8aef192-8236-49b7-ba80-d2da99b8bb32 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] 10.222.0.49 "GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d" status: 200 len: 1574 microversion: 2.1 time: 0.426787 May 12 14:54:29.406313 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 428/843] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:54:28 2022] GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d => generated 1574 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:54:30.422933 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-6e73d038-3dc3-4373-8e15-9d71dc061472 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:54:30.423489 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-6e73d038-3dc3-4373-8e15-9d71dc061472 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] [instance: 7855c920-9df4-495a-9733-78fe42b1705d] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:54:30.431462 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-6e73d038-3dc3-4373-8e15-9d71dc061472 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:30.431918 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-6e73d038-3dc3-4373-8e15-9d71dc061472 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:30.432701 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-6e73d038-3dc3-4373-8e15-9d71dc061472 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:30.433144 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-6e73d038-3dc3-4373-8e15-9d71dc061472 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:30.629457 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-6e73d038-3dc3-4373-8e15-9d71dc061472 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6d3863350647cdb3091c1006d56c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfe8d8bce3f496d9162c7f9c8727273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:54:30.642780 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-6e73d038-3dc3-4373-8e15-9d71dc061472 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] 10.222.0.49 "GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d" status: 200 len: 1574 microversion: 2.1 time: 0.223667 May 12 14:54:30.644165 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 416/844] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:54:30 2022] GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d => generated 1574 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:54:31.660967 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-086ed377-35ff-4789-a6af-e0408aac8f31 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:54:31.661587 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-086ed377-35ff-4789-a6af-e0408aac8f31 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] [instance: 7855c920-9df4-495a-9733-78fe42b1705d] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:54:31.669132 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-086ed377-35ff-4789-a6af-e0408aac8f31 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:31.669661 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-086ed377-35ff-4789-a6af-e0408aac8f31 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:31.670360 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-086ed377-35ff-4789-a6af-e0408aac8f31 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:31.670825 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-086ed377-35ff-4789-a6af-e0408aac8f31 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:31.867105 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-086ed377-35ff-4789-a6af-e0408aac8f31 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6d3863350647cdb3091c1006d56c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfe8d8bce3f496d9162c7f9c8727273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:54:31.875346 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-086ed377-35ff-4789-a6af-e0408aac8f31 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] 10.222.0.49 "GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d" status: 200 len: 1574 microversion: 2.1 time: 0.218893 May 12 14:54:31.875912 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 429/845] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:54:31 2022] GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d => generated 1574 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:54:32.892354 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-88c194ca-a44a-4488-b3b4-9137fe1c8f00 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:54:32.892973 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-88c194ca-a44a-4488-b3b4-9137fe1c8f00 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] [instance: 7855c920-9df4-495a-9733-78fe42b1705d] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:54:32.900848 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-88c194ca-a44a-4488-b3b4-9137fe1c8f00 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:32.901331 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-88c194ca-a44a-4488-b3b4-9137fe1c8f00 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:32.902107 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-88c194ca-a44a-4488-b3b4-9137fe1c8f00 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:32.902551 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-88c194ca-a44a-4488-b3b4-9137fe1c8f00 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:33.257472 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-88c194ca-a44a-4488-b3b4-9137fe1c8f00 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6d3863350647cdb3091c1006d56c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfe8d8bce3f496d9162c7f9c8727273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:54:33.265776 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-88c194ca-a44a-4488-b3b4-9137fe1c8f00 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] 10.222.0.49 "GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d" status: 200 len: 1574 microversion: 2.1 time: 0.377142 May 12 14:54:33.266342 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 417/846] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:54:32 2022] GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d => generated 1574 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:54:34.283214 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-92405d23-2b30-46c1-b295-a7d2a4752b82 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:54:34.284414 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-92405d23-2b30-46c1-b295-a7d2a4752b82 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] [instance: 7855c920-9df4-495a-9733-78fe42b1705d] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:54:34.291614 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-92405d23-2b30-46c1-b295-a7d2a4752b82 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:34.292101 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-92405d23-2b30-46c1-b295-a7d2a4752b82 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:34.296779 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-92405d23-2b30-46c1-b295-a7d2a4752b82 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:34.296779 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-92405d23-2b30-46c1-b295-a7d2a4752b82 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:34.493765 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-92405d23-2b30-46c1-b295-a7d2a4752b82 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6d3863350647cdb3091c1006d56c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfe8d8bce3f496d9162c7f9c8727273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:54:34.501948 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-92405d23-2b30-46c1-b295-a7d2a4752b82 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] 10.222.0.49 "GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d" status: 200 len: 1574 microversion: 2.1 time: 0.222378 May 12 14:54:34.502566 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 430/847] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:54:34 2022] GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d => generated 1574 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:54:34.805239 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [req-b4932f54-167b-48e0-97ea-691d54eecca9 req-d199b83f-19b5-457c-86cc-8a6f51f7b21b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7855c920-9df4-495a-9733-78fe42b1705d", "name": "network-vif-plugged", "status": "completed", "tag": "71d6ba38-f010-4812-ade3-cd0173c05466"}]} {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:54:34.807046 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:54:34.807046 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: warnings.warn(msg) May 12 14:54:34.816209 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [req-b4932f54-167b-48e0-97ea-691d54eecca9 req-d199b83f-19b5-457c-86cc-8a6f51f7b21b service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:34.816209 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [req-b4932f54-167b-48e0-97ea-691d54eecca9 req-d199b83f-19b5-457c-86cc-8a6f51f7b21b service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:34.831263 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.compute.server_external_events [req-b4932f54-167b-48e0-97ea-691d54eecca9 req-d199b83f-19b5-457c-86cc-8a6f51f7b21b service nova] Creating event network-vif-plugged:71d6ba38-f010-4812-ade3-cd0173c05466 for instance 7855c920-9df4-495a-9733-78fe42b1705d on hv-cinder-83118 May 12 14:54:34.836109 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [req-b4932f54-167b-48e0-97ea-691d54eecca9 req-d199b83f-19b5-457c-86cc-8a6f51f7b21b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034908 May 12 14:54:34.836692 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 418/848] 10.222.0.49 () {64 vars in 1317 bytes} [Thu May 12 14:54:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:54:35.462491 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-e5055dcb-6ac8-4fc3-85ba-2bdae32c2f1d tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:54:35.463527 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-e5055dcb-6ac8-4fc3-85ba-2bdae32c2f1d tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 358a3c59-ec18-40a6-b2a2-d7a37b46d08f] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:54:35.480155 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e5055dcb-6ac8-4fc3-85ba-2bdae32c2f1d tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:35.480608 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e5055dcb-6ac8-4fc3-85ba-2bdae32c2f1d tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:35.481401 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e5055dcb-6ac8-4fc3-85ba-2bdae32c2f1d tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:35.481836 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e5055dcb-6ac8-4fc3-85ba-2bdae32c2f1d tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:35.520060 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-8d47560d-9c0a-4031-a5a4-a6e67b15fb11 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:54:35.520759 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-8d47560d-9c0a-4031-a5a4-a6e67b15fb11 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] [instance: 7855c920-9df4-495a-9733-78fe42b1705d] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:54:35.528261 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-8d47560d-9c0a-4031-a5a4-a6e67b15fb11 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:35.528715 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-8d47560d-9c0a-4031-a5a4-a6e67b15fb11 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:35.529513 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-8d47560d-9c0a-4031-a5a4-a6e67b15fb11 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:35.529950 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-8d47560d-9c0a-4031-a5a4-a6e67b15fb11 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:35.557970 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-e5055dcb-6ac8-4fc3-85ba-2bdae32c2f1d tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "GET /compute/v2.1/servers/358a3c59-ec18-40a6-b2a2-d7a37b46d08f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088820 May 12 14:54:35.557970 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 431/849] 10.222.0.49 () {58 vars in 1301 bytes} [Thu May 12 14:54:35 2022] GET /compute/v2.1/servers/358a3c59-ec18-40a6-b2a2-d7a37b46d08f/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:54:35.557970 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-84fba815-fe74-4097-aa75-612bb0707030 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:54:35.557970 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-84fba815-fe74-4097-aa75-612bb0707030 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 358a3c59-ec18-40a6-b2a2-d7a37b46d08f] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:54:35.565734 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-84fba815-fe74-4097-aa75-612bb0707030 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:35.566176 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-84fba815-fe74-4097-aa75-612bb0707030 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:35.566977 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-84fba815-fe74-4097-aa75-612bb0707030 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:35.567406 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-84fba815-fe74-4097-aa75-612bb0707030 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:35.630726 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-84fba815-fe74-4097-aa75-612bb0707030 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "GET /compute/v2.1/servers/358a3c59-ec18-40a6-b2a2-d7a37b46d08f/os-volume_attachments/207a565d-f61a-46ec-9330-eeea20c5a1af" status: 200 len: 194 microversion: 2.1 time: 0.076737 May 12 14:54:35.637162 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 432/850] 10.222.0.49 () {58 vars in 1412 bytes} [Thu May 12 14:54:35 2022] GET /compute/v2.1/servers/358a3c59-ec18-40a6-b2a2-d7a37b46d08f/os-volume_attachments/207a565d-f61a-46ec-9330-eeea20c5a1af => generated 194 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 14:54:35.727375 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-8d47560d-9c0a-4031-a5a4-a6e67b15fb11 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6d3863350647cdb3091c1006d56c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfe8d8bce3f496d9162c7f9c8727273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:54:35.735624 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-8d47560d-9c0a-4031-a5a4-a6e67b15fb11 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] 10.222.0.49 "GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d" status: 200 len: 1574 microversion: 2.1 time: 0.220155 May 12 14:54:35.736169 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 419/851] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:54:35 2022] GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d => generated 1574 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:54:36.753385 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-73b3633f-c427-40b8-9293-e834ab61701c tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:54:36.753981 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-73b3633f-c427-40b8-9293-e834ab61701c tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] [instance: 7855c920-9df4-495a-9733-78fe42b1705d] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:54:36.761589 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-73b3633f-c427-40b8-9293-e834ab61701c tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:36.762031 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-73b3633f-c427-40b8-9293-e834ab61701c tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:36.762785 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-73b3633f-c427-40b8-9293-e834ab61701c tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:36.763240 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-73b3633f-c427-40b8-9293-e834ab61701c tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:36.967928 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-73b3633f-c427-40b8-9293-e834ab61701c tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6d3863350647cdb3091c1006d56c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfe8d8bce3f496d9162c7f9c8727273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:54:36.976560 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-73b3633f-c427-40b8-9293-e834ab61701c tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] 10.222.0.49 "GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d" status: 200 len: 1574 microversion: 2.1 time: 0.227435 May 12 14:54:36.977124 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 433/852] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:54:36 2022] GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d => generated 1574 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:54:37.993878 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-465e5579-2fcc-4f47-84e1-3c18771c1dba tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:54:37.994484 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-465e5579-2fcc-4f47-84e1-3c18771c1dba tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] [instance: 7855c920-9df4-495a-9733-78fe42b1705d] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:54:38.001632 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-465e5579-2fcc-4f47-84e1-3c18771c1dba tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:38.002077 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-465e5579-2fcc-4f47-84e1-3c18771c1dba tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:38.003409 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-465e5579-2fcc-4f47-84e1-3c18771c1dba tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:38.003837 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-465e5579-2fcc-4f47-84e1-3c18771c1dba tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:38.203660 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-465e5579-2fcc-4f47-84e1-3c18771c1dba tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6d3863350647cdb3091c1006d56c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfe8d8bce3f496d9162c7f9c8727273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:54:38.212112 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-465e5579-2fcc-4f47-84e1-3c18771c1dba tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] 10.222.0.49 "GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d" status: 200 len: 1561 microversion: 2.1 time: 0.221944 May 12 14:54:38.212675 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 420/853] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:54:37 2022] GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d => generated 1561 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:54:38.984234 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-57a14753-8313-440b-a0aa-2781e9c8853f tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "43daab27-cff4-426d-967c-7ea4b5a44418"}} {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:54:38.985349 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-57a14753-8313-440b-a0aa-2781e9c8853f tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 358a3c59-ec18-40a6-b2a2-d7a37b46d08f] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:54:38.993122 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-57a14753-8313-440b-a0aa-2781e9c8853f tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:38.993574 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-57a14753-8313-440b-a0aa-2781e9c8853f tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:38.994345 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-57a14753-8313-440b-a0aa-2781e9c8853f tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:38.994784 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-57a14753-8313-440b-a0aa-2781e9c8853f tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:40.471121 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-57a14753-8313-440b-a0aa-2781e9c8853f tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "POST /compute/v2.1/servers/358a3c59-ec18-40a6-b2a2-d7a37b46d08f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.490506 May 12 14:54:40.472510 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 434/854] 10.222.0.49 () {60 vars in 1322 bytes} [Thu May 12 14:54:38 2022] POST /compute/v2.1/servers/358a3c59-ec18-40a6-b2a2-d7a37b46d08f/os-volume_attachments => generated 194 bytes in 1493 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:54:51.618790 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-09604078-de70-49f3-91e1-44063485def2 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:54:51.619713 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-09604078-de70-49f3-91e1-44063485def2 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 358a3c59-ec18-40a6-b2a2-d7a37b46d08f] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:54:51.627120 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-09604078-de70-49f3-91e1-44063485def2 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:51.628114 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-09604078-de70-49f3-91e1-44063485def2 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:51.628888 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-09604078-de70-49f3-91e1-44063485def2 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:51.629522 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-09604078-de70-49f3-91e1-44063485def2 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:51.696735 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-09604078-de70-49f3-91e1-44063485def2 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "GET /compute/v2.1/servers/358a3c59-ec18-40a6-b2a2-d7a37b46d08f/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.081658 May 12 14:54:51.697282 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 421/855] 10.222.0.49 () {58 vars in 1301 bytes} [Thu May 12 14:54:51 2022] GET /compute/v2.1/servers/358a3c59-ec18-40a6-b2a2-d7a37b46d08f/os-volume_attachments => generated 371 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:54:51.845027 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-78ee018c-3ed1-44cd-9318-840e3e77399d tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:54:51.845583 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-78ee018c-3ed1-44cd-9318-840e3e77399d tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 358a3c59-ec18-40a6-b2a2-d7a37b46d08f] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:54:51.854646 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-78ee018c-3ed1-44cd-9318-840e3e77399d tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:51.855217 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-78ee018c-3ed1-44cd-9318-840e3e77399d tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:51.856041 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-78ee018c-3ed1-44cd-9318-840e3e77399d tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:51.856479 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-78ee018c-3ed1-44cd-9318-840e3e77399d tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:51.920724 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-78ee018c-3ed1-44cd-9318-840e3e77399d tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "GET /compute/v2.1/servers/358a3c59-ec18-40a6-b2a2-d7a37b46d08f/os-volume_attachments/207a565d-f61a-46ec-9330-eeea20c5a1af" status: 200 len: 194 microversion: 2.1 time: 0.079883 May 12 14:54:51.921333 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 435/856] 10.222.0.49 () {58 vars in 1412 bytes} [Thu May 12 14:54:51 2022] GET /compute/v2.1/servers/358a3c59-ec18-40a6-b2a2-d7a37b46d08f/os-volume_attachments/207a565d-f61a-46ec-9330-eeea20c5a1af => generated 194 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:54:51.930765 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-8892c52a-a6ca-4c7d-b142-d60a8c48842e tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:54:51.931295 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-8892c52a-a6ca-4c7d-b142-d60a8c48842e tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 358a3c59-ec18-40a6-b2a2-d7a37b46d08f] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:54:51.939211 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-8892c52a-a6ca-4c7d-b142-d60a8c48842e tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:51.939719 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-8892c52a-a6ca-4c7d-b142-d60a8c48842e tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:51.940488 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-8892c52a-a6ca-4c7d-b142-d60a8c48842e tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:51.940920 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-8892c52a-a6ca-4c7d-b142-d60a8c48842e tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:52.086009 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.objects.instance [None req-8892c52a-a6ca-4c7d-b142-d60a8c48842e tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lazy-loading 'services' on Instance uuid 358a3c59-ec18-40a6-b2a2-d7a37b46d08f {{(pid=102212) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 12 14:54:52.491135 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-8892c52a-a6ca-4c7d-b142-d60a8c48842e tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "DELETE /compute/v2.1/servers/358a3c59-ec18-40a6-b2a2-d7a37b46d08f/os-volume_attachments/207a565d-f61a-46ec-9330-eeea20c5a1af" status: 202 len: 0 microversion: 2.1 time: 0.563959 May 12 14:54:52.491735 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 422/857] 10.222.0.49 () {58 vars in 1415 bytes} [Thu May 12 14:54:51 2022] DELETE /compute/v2.1/servers/358a3c59-ec18-40a6-b2a2-d7a37b46d08f/os-volume_attachments/207a565d-f61a-46ec-9330-eeea20c5a1af => generated 0 bytes in 565 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 14:54:54.869533 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-8232a15a-cfe0-49c7-bb5a-79d836e98ab9 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:54:54.870066 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-8232a15a-cfe0-49c7-bb5a-79d836e98ab9 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 358a3c59-ec18-40a6-b2a2-d7a37b46d08f] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:54:54.877746 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-8232a15a-cfe0-49c7-bb5a-79d836e98ab9 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:54.894840 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-8232a15a-cfe0-49c7-bb5a-79d836e98ab9 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:54.894840 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-8232a15a-cfe0-49c7-bb5a-79d836e98ab9 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:54.894840 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-8232a15a-cfe0-49c7-bb5a-79d836e98ab9 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:54.948197 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-8232a15a-cfe0-49c7-bb5a-79d836e98ab9 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "GET /compute/v2.1/servers/358a3c59-ec18-40a6-b2a2-d7a37b46d08f/os-volume_attachments/43daab27-cff4-426d-967c-7ea4b5a44418" status: 200 len: 194 microversion: 2.1 time: 0.082348 May 12 14:54:54.956512 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 436/858] 10.222.0.49 () {58 vars in 1412 bytes} [Thu May 12 14:54:54 2022] GET /compute/v2.1/servers/358a3c59-ec18-40a6-b2a2-d7a37b46d08f/os-volume_attachments/43daab27-cff4-426d-967c-7ea4b5a44418 => generated 194 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:54:54.963233 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-003cb85a-8f1e-454d-bafb-d5c96e9276ff tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:54:54.969034 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-003cb85a-8f1e-454d-bafb-d5c96e9276ff tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 358a3c59-ec18-40a6-b2a2-d7a37b46d08f] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:54:54.971372 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-003cb85a-8f1e-454d-bafb-d5c96e9276ff tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:54.971816 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-003cb85a-8f1e-454d-bafb-d5c96e9276ff tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:54.972587 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-003cb85a-8f1e-454d-bafb-d5c96e9276ff tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:54.973010 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-003cb85a-8f1e-454d-bafb-d5c96e9276ff tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:55.118599 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.objects.instance [None req-003cb85a-8f1e-454d-bafb-d5c96e9276ff tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lazy-loading 'services' on Instance uuid 358a3c59-ec18-40a6-b2a2-d7a37b46d08f {{(pid=102212) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 12 14:54:55.414353 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-003cb85a-8f1e-454d-bafb-d5c96e9276ff tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "DELETE /compute/v2.1/servers/358a3c59-ec18-40a6-b2a2-d7a37b46d08f/os-volume_attachments/43daab27-cff4-426d-967c-7ea4b5a44418" status: 202 len: 0 microversion: 2.1 time: 0.455568 May 12 14:54:55.415346 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 423/859] 10.222.0.49 () {58 vars in 1415 bytes} [Thu May 12 14:54:54 2022] DELETE /compute/v2.1/servers/358a3c59-ec18-40a6-b2a2-d7a37b46d08f/os-volume_attachments/43daab27-cff4-426d-967c-7ea4b5a44418 => generated 0 bytes in 458 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 14:54:57.773730 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-5da260ad-71ce-4334-b477-b8cb77863795 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:54:57.774661 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-5da260ad-71ce-4334-b477-b8cb77863795 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 358a3c59-ec18-40a6-b2a2-d7a37b46d08f] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:54:57.782309 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-5da260ad-71ce-4334-b477-b8cb77863795 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:57.782759 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-5da260ad-71ce-4334-b477-b8cb77863795 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:57.783594 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-5da260ad-71ce-4334-b477-b8cb77863795 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:57.784288 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-5da260ad-71ce-4334-b477-b8cb77863795 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:57.847468 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-5da260ad-71ce-4334-b477-b8cb77863795 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "GET /compute/v2.1/servers/358a3c59-ec18-40a6-b2a2-d7a37b46d08f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.077453 May 12 14:54:57.848016 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 437/860] 10.222.0.49 () {58 vars in 1301 bytes} [Thu May 12 14:54:57 2022] GET /compute/v2.1/servers/358a3c59-ec18-40a6-b2a2-d7a37b46d08f/os-volume_attachments => generated 25 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 12 14:54:58.009867 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-6f48920a-08d1-47c9-972f-cf86928de643 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:54:58.013870 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-6f48920a-08d1-47c9-972f-cf86928de643 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 358a3c59-ec18-40a6-b2a2-d7a37b46d08f] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:54:58.018213 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-6f48920a-08d1-47c9-972f-cf86928de643 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:58.018672 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-6f48920a-08d1-47c9-972f-cf86928de643 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:58.019471 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-6f48920a-08d1-47c9-972f-cf86928de643 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:58.019905 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-6f48920a-08d1-47c9-972f-cf86928de643 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:58.083422 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-6f48920a-08d1-47c9-972f-cf86928de643 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "GET /compute/v2.1/servers/358a3c59-ec18-40a6-b2a2-d7a37b46d08f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.077671 May 12 14:54:58.083963 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 424/861] 10.222.0.49 () {58 vars in 1301 bytes} [Thu May 12 14:54:58 2022] GET /compute/v2.1/servers/358a3c59-ec18-40a6-b2a2-d7a37b46d08f/os-volume_attachments => generated 25 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 12 14:54:58.171077 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-1793513b-cce7-4a03-9d70-0cc052d160dd tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:54:58.176012 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-1793513b-cce7-4a03-9d70-0cc052d160dd tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 358a3c59-ec18-40a6-b2a2-d7a37b46d08f] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:54:58.179676 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-1793513b-cce7-4a03-9d70-0cc052d160dd tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:58.180135 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-1793513b-cce7-4a03-9d70-0cc052d160dd tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:58.180939 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-1793513b-cce7-4a03-9d70-0cc052d160dd tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:58.181386 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-1793513b-cce7-4a03-9d70-0cc052d160dd tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:58.242030 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-1793513b-cce7-4a03-9d70-0cc052d160dd tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 358a3c59-ec18-40a6-b2a2-d7a37b46d08f] Going to try to terminate instance {{(pid=102213) delete /opt/stack/nova/nova/compute/api.py:2562}} May 12 14:54:58.662898 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-1793513b-cce7-4a03-9d70-0cc052d160dd tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "DELETE /compute/v2.1/servers/358a3c59-ec18-40a6-b2a2-d7a37b46d08f" status: 204 len: 0 microversion: 2.1 time: 0.495097 May 12 14:54:58.663482 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 438/862] 10.222.0.49 () {58 vars in 1238 bytes} [Thu May 12 14:54:58 2022] DELETE /compute/v2.1/servers/358a3c59-ec18-40a6-b2a2-d7a37b46d08f => generated 0 bytes in 497 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 14:54:58.671319 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-3fb5549a-1e2b-434a-9521-cbe9a412a10d tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:54:58.671935 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-3fb5549a-1e2b-434a-9521-cbe9a412a10d tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 358a3c59-ec18-40a6-b2a2-d7a37b46d08f] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:54:58.679272 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-3fb5549a-1e2b-434a-9521-cbe9a412a10d tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:58.679728 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-3fb5549a-1e2b-434a-9521-cbe9a412a10d tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:58.680610 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-3fb5549a-1e2b-434a-9521-cbe9a412a10d tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:58.681057 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-3fb5549a-1e2b-434a-9521-cbe9a412a10d tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:58.880884 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-3fb5549a-1e2b-434a-9521-cbe9a412a10d tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e128ca83d6448c9ab1fe7dcc5467d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a090a68e336b4562aca524a95f550e04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:54:58.889136 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-3fb5549a-1e2b-434a-9521-cbe9a412a10d tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "GET /compute/v2.1/servers/358a3c59-ec18-40a6-b2a2-d7a37b46d08f" status: 200 len: 1674 microversion: 2.1 time: 0.221475 May 12 14:54:58.889692 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 425/863] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:54:58 2022] GET /compute/v2.1/servers/358a3c59-ec18-40a6-b2a2-d7a37b46d08f => generated 1674 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:54:59.906727 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-df2f3f4f-db15-43aa-9989-cc656a0e00d1 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:54:59.907453 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-df2f3f4f-db15-43aa-9989-cc656a0e00d1 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 358a3c59-ec18-40a6-b2a2-d7a37b46d08f] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:54:59.914875 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-df2f3f4f-db15-43aa-9989-cc656a0e00d1 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:59.915330 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-df2f3f4f-db15-43aa-9989-cc656a0e00d1 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:54:59.916098 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-df2f3f4f-db15-43aa-9989-cc656a0e00d1 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:54:59.916532 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-df2f3f4f-db15-43aa-9989-cc656a0e00d1 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:00.257387 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-df2f3f4f-db15-43aa-9989-cc656a0e00d1 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e128ca83d6448c9ab1fe7dcc5467d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a090a68e336b4562aca524a95f550e04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:00.265629 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-df2f3f4f-db15-43aa-9989-cc656a0e00d1 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "GET /compute/v2.1/servers/358a3c59-ec18-40a6-b2a2-d7a37b46d08f" status: 200 len: 1674 microversion: 2.1 time: 0.362983 May 12 14:55:00.266194 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 439/864] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:54:59 2022] GET /compute/v2.1/servers/358a3c59-ec18-40a6-b2a2-d7a37b46d08f => generated 1674 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:55:00.677489 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-cf4e34c7-9e06-4112-aa44-37226c00ead2 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:55:00.678048 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-cf4e34c7-9e06-4112-aa44-37226c00ead2 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 59dadfa9-df81-4e69-aa33-d99984dbebfc] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:55:00.685326 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-cf4e34c7-9e06-4112-aa44-37226c00ead2 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:00.685780 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-cf4e34c7-9e06-4112-aa44-37226c00ead2 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:00.686551 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-cf4e34c7-9e06-4112-aa44-37226c00ead2 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:00.687038 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-cf4e34c7-9e06-4112-aa44-37226c00ead2 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:00.745630 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-cf4e34c7-9e06-4112-aa44-37226c00ead2 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/59dadfa9-df81-4e69-aa33-d99984dbebfc/ips" status: 200 len: 148 microversion: 2.1 time: 0.071845 May 12 14:55:00.746191 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 426/865] 10.222.0.49 () {58 vars in 1247 bytes} [Thu May 12 14:55:00 2022] GET /compute/v2.1/servers/59dadfa9-df81-4e69-aa33-d99984dbebfc/ips => generated 148 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:55:00.972366 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-9e7c63e4-0521-4078-a2c3-d50d97b2d210 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:55:00.976429 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-9e7c63e4-0521-4078-a2c3-d50d97b2d210 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: 5184e752-c944-4ecd-a516-600944c18dc1] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:55:00.980089 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-9e7c63e4-0521-4078-a2c3-d50d97b2d210 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:00.980534 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-9e7c63e4-0521-4078-a2c3-d50d97b2d210 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:00.981294 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-9e7c63e4-0521-4078-a2c3-d50d97b2d210 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:00.981718 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-9e7c63e4-0521-4078-a2c3-d50d97b2d210 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:01.051243 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-9e7c63e4-0521-4078-a2c3-d50d97b2d210 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1/ips" status: 200 len: 150 microversion: 2.20 time: 0.259484 May 12 14:55:01.051791 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 440/866] 10.222.0.49 () {60 vars in 1288 bytes} [Thu May 12 14:55:00 2022] GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1/ips => generated 150 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 14:55:01.282137 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-2590e6cf-59c3-40cd-b7fe-3824729ea210 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:55:01.282787 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-2590e6cf-59c3-40cd-b7fe-3824729ea210 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 358a3c59-ec18-40a6-b2a2-d7a37b46d08f] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:55:01.290211 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-2590e6cf-59c3-40cd-b7fe-3824729ea210 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:01.290667 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-2590e6cf-59c3-40cd-b7fe-3824729ea210 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:01.291471 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-2590e6cf-59c3-40cd-b7fe-3824729ea210 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:01.291907 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-2590e6cf-59c3-40cd-b7fe-3824729ea210 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:01.506577 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-2590e6cf-59c3-40cd-b7fe-3824729ea210 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e128ca83d6448c9ab1fe7dcc5467d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a090a68e336b4562aca524a95f550e04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:01.515610 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-2590e6cf-59c3-40cd-b7fe-3824729ea210 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "GET /compute/v2.1/servers/358a3c59-ec18-40a6-b2a2-d7a37b46d08f" status: 200 len: 1674 microversion: 2.1 time: 0.237228 May 12 14:55:01.520351 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 427/867] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:55:01 2022] GET /compute/v2.1/servers/358a3c59-ec18-40a6-b2a2-d7a37b46d08f => generated 1674 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:55:02.533041 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-193f13b2-7297-45c5-9a34-f5db4d6e2320 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:55:02.534536 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-193f13b2-7297-45c5-9a34-f5db4d6e2320 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 358a3c59-ec18-40a6-b2a2-d7a37b46d08f] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:55:02.542300 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-193f13b2-7297-45c5-9a34-f5db4d6e2320 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:02.542744 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-193f13b2-7297-45c5-9a34-f5db4d6e2320 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:02.543545 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-193f13b2-7297-45c5-9a34-f5db4d6e2320 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:02.543977 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-193f13b2-7297-45c5-9a34-f5db4d6e2320 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:02.738196 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-193f13b2-7297-45c5-9a34-f5db4d6e2320 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e128ca83d6448c9ab1fe7dcc5467d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a090a68e336b4562aca524a95f550e04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:02.746571 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-193f13b2-7297-45c5-9a34-f5db4d6e2320 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "GET /compute/v2.1/servers/358a3c59-ec18-40a6-b2a2-d7a37b46d08f" status: 200 len: 1674 microversion: 2.1 time: 0.217284 May 12 14:55:02.747279 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 441/868] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:55:02 2022] GET /compute/v2.1/servers/358a3c59-ec18-40a6-b2a2-d7a37b46d08f => generated 1674 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:55:03.597476 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-b2a8ca9b-88e9-44a5-a03f-0fb343ed5a5c tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1c53ed70-8ea7-4591-80af-32890583b565"}} {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:55:03.598600 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-b2a8ca9b-88e9-44a5-a03f-0fb343ed5a5c tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 59dadfa9-df81-4e69-aa33-d99984dbebfc] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:55:03.606194 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-b2a8ca9b-88e9-44a5-a03f-0fb343ed5a5c tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:03.606647 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-b2a8ca9b-88e9-44a5-a03f-0fb343ed5a5c tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:03.607460 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-b2a8ca9b-88e9-44a5-a03f-0fb343ed5a5c tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:03.607907 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-b2a8ca9b-88e9-44a5-a03f-0fb343ed5a5c tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:03.763939 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-8623913b-8731-4286-89e4-d2a26684dddb tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:55:03.764882 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-8623913b-8731-4286-89e4-d2a26684dddb tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 358a3c59-ec18-40a6-b2a2-d7a37b46d08f] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:55:03.774065 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-8623913b-8731-4286-89e4-d2a26684dddb tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:03.774850 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-8623913b-8731-4286-89e4-d2a26684dddb tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:03.775598 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-8623913b-8731-4286-89e4-d2a26684dddb tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:03.776042 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-8623913b-8731-4286-89e4-d2a26684dddb tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:03.901610 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-8623913b-8731-4286-89e4-d2a26684dddb tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e128ca83d6448c9ab1fe7dcc5467d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a090a68e336b4562aca524a95f550e04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:03.910459 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-8623913b-8731-4286-89e4-d2a26684dddb tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "GET /compute/v2.1/servers/358a3c59-ec18-40a6-b2a2-d7a37b46d08f" status: 200 len: 1606 microversion: 2.1 time: 0.150570 May 12 14:55:03.911039 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 442/869] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:55:03 2022] GET /compute/v2.1/servers/358a3c59-ec18-40a6-b2a2-d7a37b46d08f => generated 1606 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:55:03.925028 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [req-3cd5d293-fd7c-4f53-b46d-c0e62fd325aa req-194caa2d-ef68-4f85-a084-7cf17d29d384 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "358a3c59-ec18-40a6-b2a2-d7a37b46d08f", "name": "network-vif-deleted", "tag": "29d1dc1e-72a2-437b-94bf-fcacd84119d4"}]} {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:55:03.926579 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:55:03.926579 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: warnings.warn(msg) May 12 14:55:03.934530 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [req-3cd5d293-fd7c-4f53-b46d-c0e62fd325aa req-194caa2d-ef68-4f85-a084-7cf17d29d384 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:03.935023 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [req-3cd5d293-fd7c-4f53-b46d-c0e62fd325aa req-194caa2d-ef68-4f85-a084-7cf17d29d384 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:03.950621 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.compute.server_external_events [req-3cd5d293-fd7c-4f53-b46d-c0e62fd325aa req-194caa2d-ef68-4f85-a084-7cf17d29d384 service nova] Creating event network-vif-deleted:29d1dc1e-72a2-437b-94bf-fcacd84119d4 for instance 358a3c59-ec18-40a6-b2a2-d7a37b46d08f on hv-cinder-83118 May 12 14:55:03.955547 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [req-3cd5d293-fd7c-4f53-b46d-c0e62fd325aa req-194caa2d-ef68-4f85-a084-7cf17d29d384 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034453 May 12 14:55:03.956131 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 443/870] 10.222.0.49 () {64 vars in 1317 bytes} [Thu May 12 14:55:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:55:04.928771 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-38ca0001-373e-4879-8b57-543436664cd0 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:55:04.929609 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-38ca0001-373e-4879-8b57-543436664cd0 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 358a3c59-ec18-40a6-b2a2-d7a37b46d08f] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:55:04.937021 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-38ca0001-373e-4879-8b57-543436664cd0 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:04.937462 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-38ca0001-373e-4879-8b57-543436664cd0 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:04.938227 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-38ca0001-373e-4879-8b57-543436664cd0 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:04.938653 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-38ca0001-373e-4879-8b57-543436664cd0 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:05.051578 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-38ca0001-373e-4879-8b57-543436664cd0 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e128ca83d6448c9ab1fe7dcc5467d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a090a68e336b4562aca524a95f550e04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:05.061951 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-38ca0001-373e-4879-8b57-543436664cd0 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "GET /compute/v2.1/servers/358a3c59-ec18-40a6-b2a2-d7a37b46d08f" status: 200 len: 1606 microversion: 2.1 time: 0.137908 May 12 14:55:05.062513 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 444/871] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:55:04 2022] GET /compute/v2.1/servers/358a3c59-ec18-40a6-b2a2-d7a37b46d08f => generated 1606 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:55:06.078792 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-288bc472-efa1-4b21-82d0-1816b124e352 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:55:06.079493 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-288bc472-efa1-4b21-82d0-1816b124e352 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 358a3c59-ec18-40a6-b2a2-d7a37b46d08f] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:55:06.087790 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-288bc472-efa1-4b21-82d0-1816b124e352 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:06.088239 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-288bc472-efa1-4b21-82d0-1816b124e352 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:06.089009 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-288bc472-efa1-4b21-82d0-1816b124e352 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:06.089532 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-288bc472-efa1-4b21-82d0-1816b124e352 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:06.161884 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-288bc472-efa1-4b21-82d0-1816b124e352 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:06.162336 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-288bc472-efa1-4b21-82d0-1816b124e352 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:06.162786 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.objects.instance [None req-288bc472-efa1-4b21-82d0-1816b124e352 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lazy-loading 'fault' on Instance uuid 358a3c59-ec18-40a6-b2a2-d7a37b46d08f {{(pid=102213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 12 14:55:06.218105 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-288bc472-efa1-4b21-82d0-1816b124e352 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0e128ca83d6448c9ab1fe7dcc5467d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a090a68e336b4562aca524a95f550e04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:06.226969 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-288bc472-efa1-4b21-82d0-1816b124e352 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "GET /compute/v2.1/servers/358a3c59-ec18-40a6-b2a2-d7a37b46d08f" status: 200 len: 1328 microversion: 2.1 time: 0.151937 May 12 14:55:06.227542 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 445/872] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:55:06 2022] GET /compute/v2.1/servers/358a3c59-ec18-40a6-b2a2-d7a37b46d08f => generated 1328 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:55:06.238636 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-b2a8ca9b-88e9-44a5-a03f-0fb343ed5a5c tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "POST /compute/v2.1/servers/59dadfa9-df81-4e69-aa33-d99984dbebfc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.644744 May 12 14:55:06.239270 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 428/873] 10.222.0.49 () {60 vars in 1322 bytes} [Thu May 12 14:55:03 2022] POST /compute/v2.1/servers/59dadfa9-df81-4e69-aa33-d99984dbebfc/os-volume_attachments => generated 194 bytes in 2646 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:55:06.950374 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-92471277-50ca-4929-ad7e-4cdd4bc84d28 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:55:06.950834 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-92471277-50ca-4929-ad7e-4cdd4bc84d28 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: 5184e752-c944-4ecd-a516-600944c18dc1] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:55:06.958566 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-92471277-50ca-4929-ad7e-4cdd4bc84d28 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:06.959048 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-92471277-50ca-4929-ad7e-4cdd4bc84d28 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:06.959807 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-92471277-50ca-4929-ad7e-4cdd4bc84d28 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:06.960236 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-92471277-50ca-4929-ad7e-4cdd4bc84d28 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:07.016448 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.objects.instance [None req-92471277-50ca-4929-ad7e-4cdd4bc84d28 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lazy-loading 'flavor' on Instance uuid 5184e752-c944-4ecd-a516-600944c18dc1 {{(pid=102213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 12 14:55:07.245439 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-bf6e51ac-f269-4874-afed-be2adb6ccf0c tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:55:07.246160 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-bf6e51ac-f269-4874-afed-be2adb6ccf0c tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 358a3c59-ec18-40a6-b2a2-d7a37b46d08f] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:55:07.255041 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-bf6e51ac-f269-4874-afed-be2adb6ccf0c tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:07.255484 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-bf6e51ac-f269-4874-afed-be2adb6ccf0c tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:07.256266 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-bf6e51ac-f269-4874-afed-be2adb6ccf0c tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:07.256697 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-bf6e51ac-f269-4874-afed-be2adb6ccf0c tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:07.306518 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.wsgi [None req-bf6e51ac-f269-4874-afed-be2adb6ccf0c tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] HTTP exception thrown: Instance 358a3c59-ec18-40a6-b2a2-d7a37b46d08f could not be found. May 12 14:55:07.307149 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-bf6e51ac-f269-4874-afed-be2adb6ccf0c tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Returning 404 to user: Instance 358a3c59-ec18-40a6-b2a2-d7a37b46d08f could not be found. {{(pid=102212) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 12 14:55:07.307995 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-bf6e51ac-f269-4874-afed-be2adb6ccf0c tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "GET /compute/v2.1/servers/358a3c59-ec18-40a6-b2a2-d7a37b46d08f" status: 404 len: 111 microversion: 2.1 time: 0.067218 May 12 14:55:07.308794 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 429/874] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:55:07 2022] GET /compute/v2.1/servers/358a3c59-ec18-40a6-b2a2-d7a37b46d08f => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 12 14:55:07.317142 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-e716e29a-5c73-4919-902e-f8603d3595a5 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Calling method '.version_select at 0x7ff77ea72550>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:55:07.416293 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-e716e29a-5c73-4919-902e-f8603d3595a5 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1487316631" status: 202 len: 0 microversion: 2.1 time: 0.103187 May 12 14:55:07.421855 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 430/875] 10.222.0.49 () {58 vars in 1220 bytes} [Thu May 12 14:55:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1487316631 => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 12 14:55:07.876311 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-92471277-50ca-4929-ad7e-4cdd4bc84d28 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "POST /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1/action" status: 202 len: 0 microversion: 2.20 time: 0.929508 May 12 14:55:07.877831 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 446/876] 10.222.0.49 () {62 vars in 1318 bytes} [Thu May 12 14:55:06 2022] POST /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1/action => generated 0 bytes in 932 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 12 14:55:07.888232 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-0fa60fbb-880e-48e2-973c-bb87be1d4f6e tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:55:07.888864 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-0fa60fbb-880e-48e2-973c-bb87be1d4f6e tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: 5184e752-c944-4ecd-a516-600944c18dc1] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:55:07.904346 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-0fa60fbb-880e-48e2-973c-bb87be1d4f6e tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:07.905063 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-0fa60fbb-880e-48e2-973c-bb87be1d4f6e tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:07.906391 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-0fa60fbb-880e-48e2-973c-bb87be1d4f6e tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:07.907023 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-0fa60fbb-880e-48e2-973c-bb87be1d4f6e tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:08.233398 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-0fa60fbb-880e-48e2-973c-bb87be1d4f6e tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:08.243601 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-0fa60fbb-880e-48e2-973c-bb87be1d4f6e tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:08.245112 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-0fa60fbb-880e-48e2-973c-bb87be1d4f6e tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:08.246268 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-0fa60fbb-880e-48e2-973c-bb87be1d4f6e tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1" status: 200 len: 1723 microversion: 2.20 time: 0.364604 May 12 14:55:08.246866 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 431/877] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:55:07 2022] GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1 => generated 1723 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:55:09.265265 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-24c24c93-e7db-493a-bd06-fd3a3414f690 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:55:09.265991 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-24c24c93-e7db-493a-bd06-fd3a3414f690 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: 5184e752-c944-4ecd-a516-600944c18dc1] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:55:09.274195 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-24c24c93-e7db-493a-bd06-fd3a3414f690 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:09.274643 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-24c24c93-e7db-493a-bd06-fd3a3414f690 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:09.275440 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-24c24c93-e7db-493a-bd06-fd3a3414f690 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:09.275874 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-24c24c93-e7db-493a-bd06-fd3a3414f690 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:09.472791 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-24c24c93-e7db-493a-bd06-fd3a3414f690 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:09.481338 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-24c24c93-e7db-493a-bd06-fd3a3414f690 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:09.482850 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-24c24c93-e7db-493a-bd06-fd3a3414f690 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:09.483974 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-24c24c93-e7db-493a-bd06-fd3a3414f690 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1" status: 200 len: 1723 microversion: 2.20 time: 0.222930 May 12 14:55:09.484519 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 447/878] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:55:09 2022] GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1 => generated 1723 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:55:10.502708 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-1d557974-66f3-4348-a4ef-a8dd3a8b5b06 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:55:10.503272 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-1d557974-66f3-4348-a4ef-a8dd3a8b5b06 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: 5184e752-c944-4ecd-a516-600944c18dc1] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:55:10.511033 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-1d557974-66f3-4348-a4ef-a8dd3a8b5b06 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:10.511491 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-1d557974-66f3-4348-a4ef-a8dd3a8b5b06 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:10.512268 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-1d557974-66f3-4348-a4ef-a8dd3a8b5b06 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:10.512708 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-1d557974-66f3-4348-a4ef-a8dd3a8b5b06 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:10.715260 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-1d557974-66f3-4348-a4ef-a8dd3a8b5b06 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:10.723810 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-1d557974-66f3-4348-a4ef-a8dd3a8b5b06 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:10.725296 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-1d557974-66f3-4348-a4ef-a8dd3a8b5b06 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:10.726448 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-1d557974-66f3-4348-a4ef-a8dd3a8b5b06 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1" status: 200 len: 1723 microversion: 2.20 time: 0.227584 May 12 14:55:10.727017 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 432/879] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:55:10 2022] GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1 => generated 1723 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:55:11.744679 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-f0b1863e-242c-418a-8fe2-ce33aba77900 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:55:11.745299 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-f0b1863e-242c-418a-8fe2-ce33aba77900 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: 5184e752-c944-4ecd-a516-600944c18dc1] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:55:11.753088 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-f0b1863e-242c-418a-8fe2-ce33aba77900 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:11.753584 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-f0b1863e-242c-418a-8fe2-ce33aba77900 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:11.754386 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-f0b1863e-242c-418a-8fe2-ce33aba77900 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:11.754835 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-f0b1863e-242c-418a-8fe2-ce33aba77900 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:11.945370 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-f0b1863e-242c-418a-8fe2-ce33aba77900 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:11.953970 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-f0b1863e-242c-418a-8fe2-ce33aba77900 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:11.955569 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-f0b1863e-242c-418a-8fe2-ce33aba77900 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:11.956689 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-f0b1863e-242c-418a-8fe2-ce33aba77900 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1" status: 200 len: 1723 microversion: 2.20 time: 0.215802 May 12 14:55:11.957242 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 448/880] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:55:11 2022] GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1 => generated 1723 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:55:12.974671 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-5851bd1b-2df4-4a45-b9be-e9e662347582 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:55:12.975303 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-5851bd1b-2df4-4a45-b9be-e9e662347582 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: 5184e752-c944-4ecd-a516-600944c18dc1] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:55:12.982445 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-5851bd1b-2df4-4a45-b9be-e9e662347582 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:12.982926 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-5851bd1b-2df4-4a45-b9be-e9e662347582 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:12.983685 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-5851bd1b-2df4-4a45-b9be-e9e662347582 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:12.984117 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-5851bd1b-2df4-4a45-b9be-e9e662347582 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:13.175763 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-5851bd1b-2df4-4a45-b9be-e9e662347582 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:13.184640 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-5851bd1b-2df4-4a45-b9be-e9e662347582 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:13.186151 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-5851bd1b-2df4-4a45-b9be-e9e662347582 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:13.187450 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-5851bd1b-2df4-4a45-b9be-e9e662347582 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1" status: 200 len: 1723 microversion: 2.20 time: 0.216424 May 12 14:55:13.188005 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 433/881] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:55:12 2022] GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1 => generated 1723 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:55:13.951125 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-0f57c783-50c7-4e96-bcb2-832b71e37107 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:55:13.951655 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-0f57c783-50c7-4e96-bcb2-832b71e37107 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 358a3c59-ec18-40a6-b2a2-d7a37b46d08f] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:55:13.958925 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-0f57c783-50c7-4e96-bcb2-832b71e37107 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:13.959379 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-0f57c783-50c7-4e96-bcb2-832b71e37107 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:13.960149 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-0f57c783-50c7-4e96-bcb2-832b71e37107 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:13.960591 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-0f57c783-50c7-4e96-bcb2-832b71e37107 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:14.013426 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.wsgi [None req-0f57c783-50c7-4e96-bcb2-832b71e37107 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] HTTP exception thrown: Instance 358a3c59-ec18-40a6-b2a2-d7a37b46d08f could not be found. May 12 14:55:14.014034 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-0f57c783-50c7-4e96-bcb2-832b71e37107 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Returning 404 to user: Instance 358a3c59-ec18-40a6-b2a2-d7a37b46d08f could not be found. {{(pid=102213) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 12 14:55:14.014896 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-0f57c783-50c7-4e96-bcb2-832b71e37107 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "DELETE /compute/v2.1/servers/358a3c59-ec18-40a6-b2a2-d7a37b46d08f" status: 404 len: 111 microversion: 2.1 time: 0.067412 May 12 14:55:14.015446 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 449/882] 10.222.0.49 () {58 vars in 1238 bytes} [Thu May 12 14:55:13 2022] DELETE /compute/v2.1/servers/358a3c59-ec18-40a6-b2a2-d7a37b46d08f => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 14:55:14.023211 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-1072e906-00ea-4d49-af7d-f106be238cb0 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:55:14.023822 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-1072e906-00ea-4d49-af7d-f106be238cb0 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 358a3c59-ec18-40a6-b2a2-d7a37b46d08f] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:55:14.031199 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-1072e906-00ea-4d49-af7d-f106be238cb0 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:14.031660 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-1072e906-00ea-4d49-af7d-f106be238cb0 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:14.032481 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-1072e906-00ea-4d49-af7d-f106be238cb0 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:14.032922 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-1072e906-00ea-4d49-af7d-f106be238cb0 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:14.087744 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.wsgi [None req-1072e906-00ea-4d49-af7d-f106be238cb0 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] HTTP exception thrown: Instance 358a3c59-ec18-40a6-b2a2-d7a37b46d08f could not be found. May 12 14:55:14.088347 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-1072e906-00ea-4d49-af7d-f106be238cb0 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Returning 404 to user: Instance 358a3c59-ec18-40a6-b2a2-d7a37b46d08f could not be found. {{(pid=102212) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 12 14:55:14.089182 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-1072e906-00ea-4d49-af7d-f106be238cb0 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "GET /compute/v2.1/servers/358a3c59-ec18-40a6-b2a2-d7a37b46d08f" status: 404 len: 111 microversion: 2.1 time: 0.069637 May 12 14:55:14.089715 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 434/883] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:55:14 2022] GET /compute/v2.1/servers/358a3c59-ec18-40a6-b2a2-d7a37b46d08f => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 14:55:14.205280 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-9053ece8-6902-4867-be00-0b31978bd3cd tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:55:14.205839 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-9053ece8-6902-4867-be00-0b31978bd3cd tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: 5184e752-c944-4ecd-a516-600944c18dc1] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:55:14.213112 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-9053ece8-6902-4867-be00-0b31978bd3cd tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:14.213536 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-9053ece8-6902-4867-be00-0b31978bd3cd tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:14.214287 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-9053ece8-6902-4867-be00-0b31978bd3cd tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:14.214720 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-9053ece8-6902-4867-be00-0b31978bd3cd tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:14.451849 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-9053ece8-6902-4867-be00-0b31978bd3cd tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:14.460630 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-9053ece8-6902-4867-be00-0b31978bd3cd tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:14.462046 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-9053ece8-6902-4867-be00-0b31978bd3cd tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:14.463201 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-9053ece8-6902-4867-be00-0b31978bd3cd tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1" status: 200 len: 1723 microversion: 2.20 time: 0.261748 May 12 14:55:14.463747 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 450/884] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:55:14 2022] GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1 => generated 1723 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:55:15.257420 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-3b25cfae-a67b-49f2-939f-36442387d433 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:55:15.263079 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-3b25cfae-a67b-49f2-939f-36442387d433 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 59dadfa9-df81-4e69-aa33-d99984dbebfc] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:55:15.265654 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-3b25cfae-a67b-49f2-939f-36442387d433 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:15.266105 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-3b25cfae-a67b-49f2-939f-36442387d433 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:15.266931 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-3b25cfae-a67b-49f2-939f-36442387d433 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:15.267372 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-3b25cfae-a67b-49f2-939f-36442387d433 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:15.415178 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.objects.instance [None req-3b25cfae-a67b-49f2-939f-36442387d433 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lazy-loading 'services' on Instance uuid 59dadfa9-df81-4e69-aa33-d99984dbebfc {{(pid=102212) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 12 14:55:15.481110 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-f5deae02-f318-4dd0-98a0-bb6895a71b83 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:55:15.482226 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-f5deae02-f318-4dd0-98a0-bb6895a71b83 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: 5184e752-c944-4ecd-a516-600944c18dc1] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:55:15.490761 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-f5deae02-f318-4dd0-98a0-bb6895a71b83 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:15.491243 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-f5deae02-f318-4dd0-98a0-bb6895a71b83 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:15.492010 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-f5deae02-f318-4dd0-98a0-bb6895a71b83 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:15.492443 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-f5deae02-f318-4dd0-98a0-bb6895a71b83 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:15.687131 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-f5deae02-f318-4dd0-98a0-bb6895a71b83 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:15.696699 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-f5deae02-f318-4dd0-98a0-bb6895a71b83 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:15.698251 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-f5deae02-f318-4dd0-98a0-bb6895a71b83 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:15.699406 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-f5deae02-f318-4dd0-98a0-bb6895a71b83 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1" status: 200 len: 1723 microversion: 2.20 time: 0.222035 May 12 14:55:15.699962 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 451/885] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:55:15 2022] GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1 => generated 1723 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 14:55:15.727184 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-5efc219c-b8e8-4910-886e-eec8c4fae5a9 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:55:15.736694 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-5efc219c-b8e8-4910-886e-eec8c4fae5a9 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 3062e66d-4c2a-4212-b186-ecafec6bde2e] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:55:15.736694 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-5efc219c-b8e8-4910-886e-eec8c4fae5a9 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:15.736694 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-5efc219c-b8e8-4910-886e-eec8c4fae5a9 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:15.736694 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-5efc219c-b8e8-4910-886e-eec8c4fae5a9 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:15.737034 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-5efc219c-b8e8-4910-886e-eec8c4fae5a9 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:15.773901 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-3b25cfae-a67b-49f2-939f-36442387d433 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "DELETE /compute/v2.1/servers/59dadfa9-df81-4e69-aa33-d99984dbebfc/os-volume_attachments/1c53ed70-8ea7-4591-80af-32890583b565" status: 202 len: 0 microversion: 2.1 time: 0.520021 May 12 14:55:15.774479 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 435/886] 10.222.0.49 () {58 vars in 1415 bytes} [Thu May 12 14:55:15 2022] DELETE /compute/v2.1/servers/59dadfa9-df81-4e69-aa33-d99984dbebfc/os-volume_attachments/1c53ed70-8ea7-4591-80af-32890583b565 => generated 0 bytes in 521 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 14:55:15.782827 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-5d942ece-14d3-4b68-bfc2-6c86ef84496c tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:55:15.783878 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-5d942ece-14d3-4b68-bfc2-6c86ef84496c tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 59dadfa9-df81-4e69-aa33-d99984dbebfc] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:55:15.786103 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.wsgi [None req-5efc219c-b8e8-4910-886e-eec8c4fae5a9 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] HTTP exception thrown: Instance 3062e66d-4c2a-4212-b186-ecafec6bde2e could not be found. May 12 14:55:15.786711 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-5efc219c-b8e8-4910-886e-eec8c4fae5a9 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Returning 404 to user: Instance 3062e66d-4c2a-4212-b186-ecafec6bde2e could not be found. {{(pid=102213) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 12 14:55:15.787576 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-5efc219c-b8e8-4910-886e-eec8c4fae5a9 tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "DELETE /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e" status: 404 len: 111 microversion: 2.1 time: 0.063898 May 12 14:55:15.788139 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 452/887] 10.222.0.49 () {58 vars in 1238 bytes} [Thu May 12 14:55:15 2022] DELETE /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 12 14:55:15.792541 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-5d942ece-14d3-4b68-bfc2-6c86ef84496c tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:15.792993 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-5d942ece-14d3-4b68-bfc2-6c86ef84496c tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:15.797765 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-5d942ece-14d3-4b68-bfc2-6c86ef84496c tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:15.797765 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-5d942ece-14d3-4b68-bfc2-6c86ef84496c tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:15.804686 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-7a3511a6-ba23-46ff-8561-d41e129ef81a tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:55:15.805298 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-7a3511a6-ba23-46ff-8561-d41e129ef81a tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] [instance: 3062e66d-4c2a-4212-b186-ecafec6bde2e] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:55:15.812493 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-7a3511a6-ba23-46ff-8561-d41e129ef81a tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:15.812944 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-7a3511a6-ba23-46ff-8561-d41e129ef81a tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:15.813739 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-7a3511a6-ba23-46ff-8561-d41e129ef81a tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:15.814193 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-7a3511a6-ba23-46ff-8561-d41e129ef81a tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:15.861279 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-5d942ece-14d3-4b68-bfc2-6c86ef84496c tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/59dadfa9-df81-4e69-aa33-d99984dbebfc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082313 May 12 14:55:15.862384 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 436/888] 10.222.0.49 () {58 vars in 1301 bytes} [Thu May 12 14:55:15 2022] GET /compute/v2.1/servers/59dadfa9-df81-4e69-aa33-d99984dbebfc/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 14:55:15.863827 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.wsgi [None req-7a3511a6-ba23-46ff-8561-d41e129ef81a tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] HTTP exception thrown: Instance 3062e66d-4c2a-4212-b186-ecafec6bde2e could not be found. May 12 14:55:15.864429 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-7a3511a6-ba23-46ff-8561-d41e129ef81a tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] Returning 404 to user: Instance 3062e66d-4c2a-4212-b186-ecafec6bde2e could not be found. {{(pid=102213) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 12 14:55:15.865256 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-7a3511a6-ba23-46ff-8561-d41e129ef81a tempest-AttachVolumeTestJSON-771523478 tempest-AttachVolumeTestJSON-771523478-project] 10.222.0.49 "GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e" status: 404 len: 111 microversion: 2.1 time: 0.064163 May 12 14:55:15.865795 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 453/889] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:55:15 2022] GET /compute/v2.1/servers/3062e66d-4c2a-4212-b186-ecafec6bde2e => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 12 14:55:16.717312 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-7855d0f2-8491-4ef4-a7a7-2c3539f5695c tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:55:16.717929 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-7855d0f2-8491-4ef4-a7a7-2c3539f5695c tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: 5184e752-c944-4ecd-a516-600944c18dc1] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:55:16.725134 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-7855d0f2-8491-4ef4-a7a7-2c3539f5695c tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:16.725587 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-7855d0f2-8491-4ef4-a7a7-2c3539f5695c tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:16.726385 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-7855d0f2-8491-4ef4-a7a7-2c3539f5695c tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:16.726839 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-7855d0f2-8491-4ef4-a7a7-2c3539f5695c tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:16.873471 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-40c1b1b5-a84c-49bd-9e3a-10d71f3b705a tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:55:16.874466 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-40c1b1b5-a84c-49bd-9e3a-10d71f3b705a tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 59dadfa9-df81-4e69-aa33-d99984dbebfc] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:55:16.882330 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-40c1b1b5-a84c-49bd-9e3a-10d71f3b705a tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:16.882841 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-40c1b1b5-a84c-49bd-9e3a-10d71f3b705a tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:16.883707 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-40c1b1b5-a84c-49bd-9e3a-10d71f3b705a tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:16.884141 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-40c1b1b5-a84c-49bd-9e3a-10d71f3b705a tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:16.935316 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-7855d0f2-8491-4ef4-a7a7-2c3539f5695c tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:16.945652 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-7855d0f2-8491-4ef4-a7a7-2c3539f5695c tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:16.947568 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-7855d0f2-8491-4ef4-a7a7-2c3539f5695c tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:16.949124 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-7855d0f2-8491-4ef4-a7a7-2c3539f5695c tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1" status: 200 len: 1723 microversion: 2.20 time: 0.235589 May 12 14:55:16.960105 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 437/890] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:55:16 2022] GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1 => generated 1723 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:55:16.964292 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-40c1b1b5-a84c-49bd-9e3a-10d71f3b705a tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/59dadfa9-df81-4e69-aa33-d99984dbebfc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094611 May 12 14:55:16.964853 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 454/891] 10.222.0.49 () {58 vars in 1301 bytes} [Thu May 12 14:55:16 2022] GET /compute/v2.1/servers/59dadfa9-df81-4e69-aa33-d99984dbebfc/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 14:55:17.967372 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-8d431495-ffdb-4c23-b23e-7a82118e755e tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:55:17.968077 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-8d431495-ffdb-4c23-b23e-7a82118e755e tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: 5184e752-c944-4ecd-a516-600944c18dc1] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:55:17.978307 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-8d431495-ffdb-4c23-b23e-7a82118e755e tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:17.978307 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-8d431495-ffdb-4c23-b23e-7a82118e755e tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:17.978629 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-b01c7a10-3d3a-4a24-8da1-fae5d8c3435b tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:55:17.979355 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-8d431495-ffdb-4c23-b23e-7a82118e755e tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:17.979355 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-8d431495-ffdb-4c23-b23e-7a82118e755e tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:17.979583 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-b01c7a10-3d3a-4a24-8da1-fae5d8c3435b tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 59dadfa9-df81-4e69-aa33-d99984dbebfc] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:55:17.989299 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-b01c7a10-3d3a-4a24-8da1-fae5d8c3435b tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:17.990043 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-b01c7a10-3d3a-4a24-8da1-fae5d8c3435b tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:17.991587 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-b01c7a10-3d3a-4a24-8da1-fae5d8c3435b tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:17.992220 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-b01c7a10-3d3a-4a24-8da1-fae5d8c3435b tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:18.062351 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-b01c7a10-3d3a-4a24-8da1-fae5d8c3435b tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/59dadfa9-df81-4e69-aa33-d99984dbebfc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089575 May 12 14:55:18.063268 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 455/892] 10.222.0.49 () {58 vars in 1301 bytes} [Thu May 12 14:55:17 2022] GET /compute/v2.1/servers/59dadfa9-df81-4e69-aa33-d99984dbebfc/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:55:18.201885 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-8d431495-ffdb-4c23-b23e-7a82118e755e tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:18.213134 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-8d431495-ffdb-4c23-b23e-7a82118e755e tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:18.214757 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-8d431495-ffdb-4c23-b23e-7a82118e755e tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:18.216353 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-8d431495-ffdb-4c23-b23e-7a82118e755e tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1" status: 200 len: 1723 microversion: 2.20 time: 0.252558 May 12 14:55:18.227658 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 438/893] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:55:17 2022] GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1 => generated 1723 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:55:19.074205 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-d15e555a-a452-466b-b504-19ff8cb6a2d9 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:55:19.080579 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-d15e555a-a452-466b-b504-19ff8cb6a2d9 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 59dadfa9-df81-4e69-aa33-d99984dbebfc] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:55:19.083718 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-d15e555a-a452-466b-b504-19ff8cb6a2d9 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:19.084372 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-d15e555a-a452-466b-b504-19ff8cb6a2d9 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:19.085147 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-d15e555a-a452-466b-b504-19ff8cb6a2d9 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:19.085794 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-d15e555a-a452-466b-b504-19ff8cb6a2d9 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:19.169534 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-d15e555a-a452-466b-b504-19ff8cb6a2d9 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/59dadfa9-df81-4e69-aa33-d99984dbebfc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.099326 May 12 14:55:19.170101 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 456/894] 10.222.0.49 () {58 vars in 1301 bytes} [Thu May 12 14:55:19 2022] GET /compute/v2.1/servers/59dadfa9-df81-4e69-aa33-d99984dbebfc/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:55:19.246936 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-cda50287-3804-4e7b-b81f-61cd85a23f59 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:55:19.247561 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-cda50287-3804-4e7b-b81f-61cd85a23f59 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: 5184e752-c944-4ecd-a516-600944c18dc1] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:55:19.255719 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-cda50287-3804-4e7b-b81f-61cd85a23f59 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:19.256171 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-cda50287-3804-4e7b-b81f-61cd85a23f59 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:19.256953 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-cda50287-3804-4e7b-b81f-61cd85a23f59 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:19.257392 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-cda50287-3804-4e7b-b81f-61cd85a23f59 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:19.518201 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-cda50287-3804-4e7b-b81f-61cd85a23f59 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:19.528322 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-cda50287-3804-4e7b-b81f-61cd85a23f59 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:19.529922 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-cda50287-3804-4e7b-b81f-61cd85a23f59 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:19.531253 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-cda50287-3804-4e7b-b81f-61cd85a23f59 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1" status: 200 len: 1723 microversion: 2.20 time: 0.293390 May 12 14:55:19.531819 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 439/895] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:55:19 2022] GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1 => generated 1723 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:55:20.181087 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-05e1c76b-3f7e-4636-9886-57119e0afcf0 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:55:20.182053 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-05e1c76b-3f7e-4636-9886-57119e0afcf0 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 59dadfa9-df81-4e69-aa33-d99984dbebfc] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:55:20.189957 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-05e1c76b-3f7e-4636-9886-57119e0afcf0 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:20.190413 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-05e1c76b-3f7e-4636-9886-57119e0afcf0 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:20.191219 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-05e1c76b-3f7e-4636-9886-57119e0afcf0 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:20.191653 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-05e1c76b-3f7e-4636-9886-57119e0afcf0 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:20.262487 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-05e1c76b-3f7e-4636-9886-57119e0afcf0 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/59dadfa9-df81-4e69-aa33-d99984dbebfc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.085315 May 12 14:55:20.263205 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 457/896] 10.222.0.49 () {58 vars in 1301 bytes} [Thu May 12 14:55:20 2022] GET /compute/v2.1/servers/59dadfa9-df81-4e69-aa33-d99984dbebfc/os-volume_attachments => generated 25 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 12 14:55:20.401735 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-7ce8c100-4119-43ee-80ba-95f3033d6b2b tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:55:20.401735 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-7ce8c100-4119-43ee-80ba-95f3033d6b2b tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 59dadfa9-df81-4e69-aa33-d99984dbebfc] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:55:20.401735 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-7ce8c100-4119-43ee-80ba-95f3033d6b2b tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:20.401735 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-7ce8c100-4119-43ee-80ba-95f3033d6b2b tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:20.405605 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-7ce8c100-4119-43ee-80ba-95f3033d6b2b tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:20.405605 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-7ce8c100-4119-43ee-80ba-95f3033d6b2b tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:20.445018 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-7ce8c100-4119-43ee-80ba-95f3033d6b2b tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 59dadfa9-df81-4e69-aa33-d99984dbebfc] Going to try to terminate instance {{(pid=102212) delete /opt/stack/nova/nova/compute/api.py:2562}} May 12 14:55:20.550884 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-386f0396-0500-42d3-9712-392b572bb062 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:55:20.551843 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-386f0396-0500-42d3-9712-392b572bb062 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: 5184e752-c944-4ecd-a516-600944c18dc1] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:55:20.560483 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-386f0396-0500-42d3-9712-392b572bb062 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:20.560929 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-386f0396-0500-42d3-9712-392b572bb062 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:20.561700 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-386f0396-0500-42d3-9712-392b572bb062 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:20.562127 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-386f0396-0500-42d3-9712-392b572bb062 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:20.786834 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-386f0396-0500-42d3-9712-392b572bb062 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:20.828854 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-386f0396-0500-42d3-9712-392b572bb062 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:20.832205 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-386f0396-0500-42d3-9712-392b572bb062 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:20.833669 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-386f0396-0500-42d3-9712-392b572bb062 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1" status: 200 len: 1723 microversion: 2.20 time: 0.288046 May 12 14:55:20.836063 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 458/897] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:55:20 2022] GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1 => generated 1723 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 14:55:20.896725 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-7ce8c100-4119-43ee-80ba-95f3033d6b2b tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "DELETE /compute/v2.1/servers/59dadfa9-df81-4e69-aa33-d99984dbebfc" status: 204 len: 0 microversion: 2.1 time: 0.541898 May 12 14:55:20.902140 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 440/898] 10.222.0.49 () {58 vars in 1238 bytes} [Thu May 12 14:55:20 2022] DELETE /compute/v2.1/servers/59dadfa9-df81-4e69-aa33-d99984dbebfc => generated 0 bytes in 543 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 14:55:20.912997 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-d54be20c-0f30-440e-9864-b57264589724 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:55:20.913986 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-d54be20c-0f30-440e-9864-b57264589724 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 59dadfa9-df81-4e69-aa33-d99984dbebfc] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:55:20.923102 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-d54be20c-0f30-440e-9864-b57264589724 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:20.924160 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-d54be20c-0f30-440e-9864-b57264589724 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:20.925530 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-d54be20c-0f30-440e-9864-b57264589724 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:20.926379 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-d54be20c-0f30-440e-9864-b57264589724 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:21.179061 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-d54be20c-0f30-440e-9864-b57264589724 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a641a08648b454780081ecc2e291066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a8451272cc41ebaf1598ed940bf09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:21.190083 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-d54be20c-0f30-440e-9864-b57264589724 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/59dadfa9-df81-4e69-aa33-d99984dbebfc" status: 200 len: 1680 microversion: 2.1 time: 0.283373 May 12 14:55:21.202249 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 459/899] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:55:20 2022] GET /compute/v2.1/servers/59dadfa9-df81-4e69-aa33-d99984dbebfc => generated 1680 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:55:21.854146 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-734050e7-4746-488f-a933-cba0f521ba24 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:55:21.854872 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-734050e7-4746-488f-a933-cba0f521ba24 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: 5184e752-c944-4ecd-a516-600944c18dc1] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:55:21.863251 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-734050e7-4746-488f-a933-cba0f521ba24 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:21.863708 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-734050e7-4746-488f-a933-cba0f521ba24 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:21.864543 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-734050e7-4746-488f-a933-cba0f521ba24 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:21.864982 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-734050e7-4746-488f-a933-cba0f521ba24 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:22.085996 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-734050e7-4746-488f-a933-cba0f521ba24 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:22.095109 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-734050e7-4746-488f-a933-cba0f521ba24 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:22.097230 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-734050e7-4746-488f-a933-cba0f521ba24 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:22.098408 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-734050e7-4746-488f-a933-cba0f521ba24 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1" status: 200 len: 1723 microversion: 2.20 time: 0.248583 May 12 14:55:22.098999 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 441/900] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:55:21 2022] GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1 => generated 1723 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:55:22.209198 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-e8af3915-40f4-4c96-8262-f88df3fd3de4 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:55:22.209818 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-e8af3915-40f4-4c96-8262-f88df3fd3de4 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 59dadfa9-df81-4e69-aa33-d99984dbebfc] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:55:22.217527 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e8af3915-40f4-4c96-8262-f88df3fd3de4 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:22.217982 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e8af3915-40f4-4c96-8262-f88df3fd3de4 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:22.218851 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e8af3915-40f4-4c96-8262-f88df3fd3de4 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:22.219292 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e8af3915-40f4-4c96-8262-f88df3fd3de4 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:22.418714 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-e8af3915-40f4-4c96-8262-f88df3fd3de4 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a641a08648b454780081ecc2e291066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a8451272cc41ebaf1598ed940bf09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:22.426879 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-e8af3915-40f4-4c96-8262-f88df3fd3de4 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/59dadfa9-df81-4e69-aa33-d99984dbebfc" status: 200 len: 1680 microversion: 2.1 time: 0.221894 May 12 14:55:22.427442 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 460/901] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:55:22 2022] GET /compute/v2.1/servers/59dadfa9-df81-4e69-aa33-d99984dbebfc => generated 1680 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:55:23.116805 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-8dd84ed4-8d62-4383-bcc9-fb2fe0829a64 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:55:23.117414 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-8dd84ed4-8d62-4383-bcc9-fb2fe0829a64 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: 5184e752-c944-4ecd-a516-600944c18dc1] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:55:23.124674 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-8dd84ed4-8d62-4383-bcc9-fb2fe0829a64 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:23.125125 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-8dd84ed4-8d62-4383-bcc9-fb2fe0829a64 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:23.125894 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-8dd84ed4-8d62-4383-bcc9-fb2fe0829a64 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:23.126332 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-8dd84ed4-8d62-4383-bcc9-fb2fe0829a64 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:23.330780 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-8dd84ed4-8d62-4383-bcc9-fb2fe0829a64 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:23.339510 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-8dd84ed4-8d62-4383-bcc9-fb2fe0829a64 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:23.341054 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-8dd84ed4-8d62-4383-bcc9-fb2fe0829a64 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:23.342186 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-8dd84ed4-8d62-4383-bcc9-fb2fe0829a64 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1" status: 200 len: 1723 microversion: 2.20 time: 0.229194 May 12 14:55:23.342735 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 442/902] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:55:23 2022] GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1 => generated 1723 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:55:23.443912 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-22a6eaac-2a5a-466d-bf2a-4829655036ee tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:55:23.444709 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-22a6eaac-2a5a-466d-bf2a-4829655036ee tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 59dadfa9-df81-4e69-aa33-d99984dbebfc] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:55:23.452165 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-22a6eaac-2a5a-466d-bf2a-4829655036ee tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:23.452677 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-22a6eaac-2a5a-466d-bf2a-4829655036ee tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:23.453505 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-22a6eaac-2a5a-466d-bf2a-4829655036ee tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:23.454001 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-22a6eaac-2a5a-466d-bf2a-4829655036ee tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:23.653046 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-22a6eaac-2a5a-466d-bf2a-4829655036ee tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a641a08648b454780081ecc2e291066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a8451272cc41ebaf1598ed940bf09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:23.661935 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-22a6eaac-2a5a-466d-bf2a-4829655036ee tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/59dadfa9-df81-4e69-aa33-d99984dbebfc" status: 200 len: 1680 microversion: 2.1 time: 0.221884 May 12 14:55:23.662495 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 461/903] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:55:23 2022] GET /compute/v2.1/servers/59dadfa9-df81-4e69-aa33-d99984dbebfc => generated 1680 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:55:24.302018 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-e4a8e051-9ca3-402b-9ab4-34516ec473ef tempest-VolumesNegativeTest-1431687901 tempest-VolumesNegativeTest-1431687901-project] Action: 'create', calling method: .version_select at 0x7ff77fbb3040>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1447838863", "metadata": {"Type": "work"}}} {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:55:24.303543 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-e4a8e051-9ca3-402b-9ab4-34516ec473ef tempest-VolumesNegativeTest-1431687901 tempest-VolumesNegativeTest-1431687901-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=102212) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 12 14:55:24.304316 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-e4a8e051-9ca3-402b-9ab4-34516ec473ef tempest-VolumesNegativeTest-1431687901 tempest-VolumesNegativeTest-1431687901-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.119069 May 12 14:55:24.304857 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 443/904] 10.222.0.49 () {60 vars in 1155 bytes} [Thu May 12 14:55:24 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 120 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 12 14:55:24.313593 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-dd78fa35-3902-46ec-998c-90493d2c459e tempest-VolumesNegativeTest-1431687901 tempest-VolumesNegativeTest-1431687901-project] Action: 'create', calling method: .version_select at 0x7ff77e9e5820>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1375712697", "metadata": {"Type": "work"}}} {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:55:24.315528 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-dd78fa35-3902-46ec-998c-90493d2c459e tempest-VolumesNegativeTest-1431687901 tempest-VolumesNegativeTest-1431687901-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=102213) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 12 14:55:24.316309 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-dd78fa35-3902-46ec-998c-90493d2c459e tempest-VolumesNegativeTest-1431687901 tempest-VolumesNegativeTest-1431687901-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.006372 May 12 14:55:24.316812 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 462/905] 10.222.0.49 () {60 vars in 1155 bytes} [Thu May 12 14:55:24 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 12 14:55:24.324799 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-9727ddef-335a-4748-90b3-bf88e41467ac tempest-VolumesNegativeTest-1431687901 tempest-VolumesNegativeTest-1431687901-project] Action: 'create', calling method: .version_select at 0x7ff77e947550>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-298497517", "metadata": {"Type": "work"}}} {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:55:24.325932 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-9727ddef-335a-4748-90b3-bf88e41467ac tempest-VolumesNegativeTest-1431687901 tempest-VolumesNegativeTest-1431687901-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=102212) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 12 14:55:24.326708 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-9727ddef-335a-4748-90b3-bf88e41467ac tempest-VolumesNegativeTest-1431687901 tempest-VolumesNegativeTest-1431687901-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.005406 May 12 14:55:24.327249 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 444/906] 10.222.0.49 () {60 vars in 1155 bytes} [Thu May 12 14:55:24 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 6 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 12 14:55:24.335663 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-5304fe7d-69ff-4664-9f40-a23c14942c62 tempest-VolumesNegativeTest-1431687901 tempest-VolumesNegativeTest-1431687901-project] Calling method '.version_select at 0x7ff77e9af160>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:55:24.361230 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-66522ce3-c4f4-4314-9908-0d3b862edd3f tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:55:24.361836 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-66522ce3-c4f4-4314-9908-0d3b862edd3f tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: 5184e752-c944-4ecd-a516-600944c18dc1] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:55:24.369229 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-66522ce3-c4f4-4314-9908-0d3b862edd3f tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:24.369683 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-66522ce3-c4f4-4314-9908-0d3b862edd3f tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:24.370450 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-66522ce3-c4f4-4314-9908-0d3b862edd3f tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:24.370911 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-66522ce3-c4f4-4314-9908-0d3b862edd3f tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:24.394687 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.wsgi [None req-5304fe7d-69ff-4664-9f40-a23c14942c62 tempest-VolumesNegativeTest-1431687901 tempest-VolumesNegativeTest-1431687901-project] HTTP exception thrown: Volume tempest-invalid-1210222607 could not be found. May 12 14:55:24.395401 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-5304fe7d-69ff-4664-9f40-a23c14942c62 tempest-VolumesNegativeTest-1431687901 tempest-VolumesNegativeTest-1431687901-project] Returning 404 to user: Volume tempest-invalid-1210222607 could not be found. {{(pid=102213) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 12 14:55:24.397212 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-5304fe7d-69ff-4664-9f40-a23c14942c62 tempest-VolumesNegativeTest-1431687901 tempest-VolumesNegativeTest-1431687901-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1210222607" status: 404 len: 99 microversion: 2.1 time: 0.064029 May 12 14:55:24.397863 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 463/907] 10.222.0.49 () {58 vars in 1217 bytes} [Thu May 12 14:55:24 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1210222607 => generated 99 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 12 14:55:24.406301 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-7daf14a5-8eaf-4f7e-9051-2812200d2c24 tempest-VolumesNegativeTest-1431687901 tempest-VolumesNegativeTest-1431687901-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003420 May 12 14:55:24.406787 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 464/908] 10.222.0.49 () {58 vars in 1139 bytes} [Thu May 12 14:55:24 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 4 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) May 12 14:55:24.415167 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-6b0f6a5c-3a25-40e4-af8b-bbd66965f00e tempest-VolumesNegativeTest-1431687901 tempest-VolumesNegativeTest-1431687901-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003309 May 12 14:55:24.415660 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 465/909] 10.222.0.49 () {58 vars in 1136 bytes} [Thu May 12 14:55:24 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 4 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) May 12 14:55:24.423366 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-042c13eb-bac6-491b-85c8-161242090067 tempest-VolumesNegativeTest-1431687901 tempest-VolumesNegativeTest-1431687901-project] Calling method '.version_select at 0x7ff77fbacf70>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:55:24.482903 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.wsgi [None req-042c13eb-bac6-491b-85c8-161242090067 tempest-VolumesNegativeTest-1431687901 tempest-VolumesNegativeTest-1431687901-project] HTTP exception thrown: Volume db79e107-24a3-4c19-94c1-d13193742887 could not be found. May 12 14:55:24.483495 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-042c13eb-bac6-491b-85c8-161242090067 tempest-VolumesNegativeTest-1431687901 tempest-VolumesNegativeTest-1431687901-project] Returning 404 to user: Volume db79e107-24a3-4c19-94c1-d13193742887 could not be found. {{(pid=102213) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 12 14:55:24.484305 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-042c13eb-bac6-491b-85c8-161242090067 tempest-VolumesNegativeTest-1431687901 tempest-VolumesNegativeTest-1431687901-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/db79e107-24a3-4c19-94c1-d13193742887" status: 404 len: 109 microversion: 2.1 time: 0.064137 May 12 14:55:24.484848 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 466/910] 10.222.0.49 () {58 vars in 1247 bytes} [Thu May 12 14:55:24 2022] DELETE /compute/v2.1/os-volumes/db79e107-24a3-4c19-94c1-d13193742887 => generated 109 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 14:55:24.494042 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-34237ad9-cb57-466c-8170-e7829ab42dd9 tempest-VolumesNegativeTest-1431687901 tempest-VolumesNegativeTest-1431687901-project] Calling method '.version_select at 0x7ff77e9e5550>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:55:24.553759 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.wsgi [None req-34237ad9-cb57-466c-8170-e7829ab42dd9 tempest-VolumesNegativeTest-1431687901 tempest-VolumesNegativeTest-1431687901-project] HTTP exception thrown: Volume 8dda5f87-0f91-4d15-a3d3-022b468e94b9 could not be found. May 12 14:55:24.554396 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-34237ad9-cb57-466c-8170-e7829ab42dd9 tempest-VolumesNegativeTest-1431687901 tempest-VolumesNegativeTest-1431687901-project] Returning 404 to user: Volume 8dda5f87-0f91-4d15-a3d3-022b468e94b9 could not be found. {{(pid=102213) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 12 14:55:24.555352 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-34237ad9-cb57-466c-8170-e7829ab42dd9 tempest-VolumesNegativeTest-1431687901 tempest-VolumesNegativeTest-1431687901-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/8dda5f87-0f91-4d15-a3d3-022b468e94b9" status: 404 len: 109 microversion: 2.1 time: 0.064905 May 12 14:55:24.555977 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 467/911] 10.222.0.49 () {58 vars in 1244 bytes} [Thu May 12 14:55:24 2022] GET /compute/v2.1/os-volumes/8dda5f87-0f91-4d15-a3d3-022b468e94b9 => generated 109 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 12 14:55:24.572122 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-66522ce3-c4f4-4314-9908-0d3b862edd3f tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:24.581082 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-66522ce3-c4f4-4314-9908-0d3b862edd3f tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:24.582725 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-66522ce3-c4f4-4314-9908-0d3b862edd3f tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:24.583964 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-66522ce3-c4f4-4314-9908-0d3b862edd3f tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1" status: 200 len: 1723 microversion: 2.20 time: 0.227050 May 12 14:55:24.592628 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 445/912] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:55:24 2022] GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1 => generated 1723 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 14:55:24.679310 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-ce0b3db4-64b2-4e2f-999a-0be4a0d8af40 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:55:24.679925 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-ce0b3db4-64b2-4e2f-999a-0be4a0d8af40 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 59dadfa9-df81-4e69-aa33-d99984dbebfc] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:55:24.687111 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-ce0b3db4-64b2-4e2f-999a-0be4a0d8af40 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:24.687558 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-ce0b3db4-64b2-4e2f-999a-0be4a0d8af40 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:24.688317 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-ce0b3db4-64b2-4e2f-999a-0be4a0d8af40 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:24.688752 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-ce0b3db4-64b2-4e2f-999a-0be4a0d8af40 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:24.895147 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-ce0b3db4-64b2-4e2f-999a-0be4a0d8af40 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a641a08648b454780081ecc2e291066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a8451272cc41ebaf1598ed940bf09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:24.902032 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-ce0b3db4-64b2-4e2f-999a-0be4a0d8af40 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/59dadfa9-df81-4e69-aa33-d99984dbebfc" status: 200 len: 1680 microversion: 2.1 time: 0.226377 May 12 14:55:24.902583 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 468/913] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:55:24 2022] GET /compute/v2.1/servers/59dadfa9-df81-4e69-aa33-d99984dbebfc => generated 1680 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:55:25.602182 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-06354932-afae-4c7d-adfb-d1e11fbb4bed tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:55:25.603007 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-06354932-afae-4c7d-adfb-d1e11fbb4bed tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: 5184e752-c944-4ecd-a516-600944c18dc1] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:55:25.610537 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-06354932-afae-4c7d-adfb-d1e11fbb4bed tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:25.617310 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-06354932-afae-4c7d-adfb-d1e11fbb4bed tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:25.617310 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-06354932-afae-4c7d-adfb-d1e11fbb4bed tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:25.617310 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-06354932-afae-4c7d-adfb-d1e11fbb4bed tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:25.922173 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-ba643c0f-e32a-455c-91fb-a31bf7ebafde tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:55:25.922787 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-ba643c0f-e32a-455c-91fb-a31bf7ebafde tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 59dadfa9-df81-4e69-aa33-d99984dbebfc] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:55:25.930827 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-ba643c0f-e32a-455c-91fb-a31bf7ebafde tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:25.931477 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-ba643c0f-e32a-455c-91fb-a31bf7ebafde tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:25.932418 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-ba643c0f-e32a-455c-91fb-a31bf7ebafde tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:25.932999 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-ba643c0f-e32a-455c-91fb-a31bf7ebafde tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:26.144414 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-06354932-afae-4c7d-adfb-d1e11fbb4bed tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:26.156103 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-06354932-afae-4c7d-adfb-d1e11fbb4bed tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:26.158169 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-06354932-afae-4c7d-adfb-d1e11fbb4bed tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:26.159934 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-06354932-afae-4c7d-adfb-d1e11fbb4bed tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1" status: 200 len: 1723 microversion: 2.20 time: 0.561093 May 12 14:55:26.165418 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 446/914] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:55:25 2022] GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1 => generated 1723 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 14:55:26.194464 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-ba643c0f-e32a-455c-91fb-a31bf7ebafde tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a641a08648b454780081ecc2e291066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a8451272cc41ebaf1598ed940bf09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:26.199116 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-ba643c0f-e32a-455c-91fb-a31bf7ebafde tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/59dadfa9-df81-4e69-aa33-d99984dbebfc" status: 200 len: 1680 microversion: 2.1 time: 0.281935 May 12 14:55:26.199679 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 469/915] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:55:25 2022] GET /compute/v2.1/servers/59dadfa9-df81-4e69-aa33-d99984dbebfc => generated 1680 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:55:27.057809 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [req-45047c45-6f5b-4d56-9823-813b45f10401 req-24f9a082-7e72-4c6e-85ec-4719b3e31367 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59dadfa9-df81-4e69-aa33-d99984dbebfc", "name": "network-vif-deleted", "tag": "00ee9d33-d084-4d18-b69d-a02dc7875eab"}]} {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:55:27.059418 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:55:27.059418 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: warnings.warn(msg) May 12 14:55:27.068502 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [req-45047c45-6f5b-4d56-9823-813b45f10401 req-24f9a082-7e72-4c6e-85ec-4719b3e31367 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:27.068955 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [req-45047c45-6f5b-4d56-9823-813b45f10401 req-24f9a082-7e72-4c6e-85ec-4719b3e31367 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:27.088297 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.compute.server_external_events [req-45047c45-6f5b-4d56-9823-813b45f10401 req-24f9a082-7e72-4c6e-85ec-4719b3e31367 service nova] Creating event network-vif-deleted:00ee9d33-d084-4d18-b69d-a02dc7875eab for instance 59dadfa9-df81-4e69-aa33-d99984dbebfc on hv-cinder-83118 May 12 14:55:27.092942 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [req-45047c45-6f5b-4d56-9823-813b45f10401 req-24f9a082-7e72-4c6e-85ec-4719b3e31367 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040691 May 12 14:55:27.093559 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 447/916] 10.222.0.49 () {64 vars in 1317 bytes} [Thu May 12 14:55:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:55:27.178569 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-5086164c-0e12-4d28-af3f-6e7fced8ec62 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:55:27.180061 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-5086164c-0e12-4d28-af3f-6e7fced8ec62 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: 5184e752-c944-4ecd-a516-600944c18dc1] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:55:27.191903 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-5086164c-0e12-4d28-af3f-6e7fced8ec62 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:27.194130 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-5086164c-0e12-4d28-af3f-6e7fced8ec62 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:27.196334 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-5086164c-0e12-4d28-af3f-6e7fced8ec62 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:27.197244 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-5086164c-0e12-4d28-af3f-6e7fced8ec62 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:27.224739 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-5390cf9f-54e8-41cb-a95a-2dd12d750b42 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:55:27.231147 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-5390cf9f-54e8-41cb-a95a-2dd12d750b42 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 59dadfa9-df81-4e69-aa33-d99984dbebfc] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:55:27.249102 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-5390cf9f-54e8-41cb-a95a-2dd12d750b42 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:27.250114 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-5390cf9f-54e8-41cb-a95a-2dd12d750b42 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:27.251576 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-5390cf9f-54e8-41cb-a95a-2dd12d750b42 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:27.252371 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-5390cf9f-54e8-41cb-a95a-2dd12d750b42 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:27.635980 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-5086164c-0e12-4d28-af3f-6e7fced8ec62 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:27.647899 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-5086164c-0e12-4d28-af3f-6e7fced8ec62 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:27.647899 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-5086164c-0e12-4d28-af3f-6e7fced8ec62 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:27.647899 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-5086164c-0e12-4d28-af3f-6e7fced8ec62 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1" status: 200 len: 1723 microversion: 2.20 time: 0.473598 May 12 14:55:27.648239 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 470/917] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:55:27 2022] GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1 => generated 1723 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:55:27.710980 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-5390cf9f-54e8-41cb-a95a-2dd12d750b42 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a641a08648b454780081ecc2e291066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67a8451272cc41ebaf1598ed940bf09a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:27.729717 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-5390cf9f-54e8-41cb-a95a-2dd12d750b42 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/59dadfa9-df81-4e69-aa33-d99984dbebfc" status: 200 len: 1326 microversion: 2.1 time: 0.515705 May 12 14:55:27.730475 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 448/918] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:55:27 2022] GET /compute/v2.1/servers/59dadfa9-df81-4e69-aa33-d99984dbebfc => generated 1326 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:55:28.665625 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-b7a22373-1ca8-4581-9dfb-c541a007bdc5 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:55:28.668374 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-b7a22373-1ca8-4581-9dfb-c541a007bdc5 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: 5184e752-c944-4ecd-a516-600944c18dc1] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:55:28.677134 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-b7a22373-1ca8-4581-9dfb-c541a007bdc5 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:28.677583 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-b7a22373-1ca8-4581-9dfb-c541a007bdc5 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:28.678387 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-b7a22373-1ca8-4581-9dfb-c541a007bdc5 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:28.678839 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-b7a22373-1ca8-4581-9dfb-c541a007bdc5 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:28.747496 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-f3147d31-c7d2-4a5c-a88b-3c6253397a53 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:55:28.748308 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-f3147d31-c7d2-4a5c-a88b-3c6253397a53 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 59dadfa9-df81-4e69-aa33-d99984dbebfc] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:55:28.755728 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-f3147d31-c7d2-4a5c-a88b-3c6253397a53 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:28.756170 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-f3147d31-c7d2-4a5c-a88b-3c6253397a53 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:28.756941 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-f3147d31-c7d2-4a5c-a88b-3c6253397a53 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:28.757398 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-f3147d31-c7d2-4a5c-a88b-3c6253397a53 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:28.807938 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.wsgi [None req-f3147d31-c7d2-4a5c-a88b-3c6253397a53 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] HTTP exception thrown: Instance 59dadfa9-df81-4e69-aa33-d99984dbebfc could not be found. May 12 14:55:28.808552 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-f3147d31-c7d2-4a5c-a88b-3c6253397a53 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Returning 404 to user: Instance 59dadfa9-df81-4e69-aa33-d99984dbebfc could not be found. {{(pid=102212) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 12 14:55:28.809391 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-f3147d31-c7d2-4a5c-a88b-3c6253397a53 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/59dadfa9-df81-4e69-aa33-d99984dbebfc" status: 404 len: 111 microversion: 2.1 time: 0.065921 May 12 14:55:28.810024 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 449/919] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:55:28 2022] GET /compute/v2.1/servers/59dadfa9-df81-4e69-aa33-d99984dbebfc => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 12 14:55:28.818423 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-abb67c5d-b300-4e4a-a512-81d109fd6798 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '.version_select at 0x7ff77e783af0>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:55:28.888424 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-b7a22373-1ca8-4581-9dfb-c541a007bdc5 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:28.897433 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-b7a22373-1ca8-4581-9dfb-c541a007bdc5 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:28.907522 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-b7a22373-1ca8-4581-9dfb-c541a007bdc5 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:28.907522 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-b7a22373-1ca8-4581-9dfb-c541a007bdc5 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1" status: 200 len: 1744 microversion: 2.20 time: 0.238232 May 12 14:55:28.907522 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 471/920] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:55:28 2022] GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1 => generated 1744 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:55:28.995672 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-abb67c5d-b300-4e4a-a512-81d109fd6798 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1183529730" status: 202 len: 0 microversion: 2.1 time: 0.181084 May 12 14:55:28.996174 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 450/921] 10.222.0.49 () {58 vars in 1220 bytes} [Thu May 12 14:55:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1183529730 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 12 14:55:29.919522 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-91089d68-3f96-40a5-b29c-3e9dc2a994ac tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:55:29.920755 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-91089d68-3f96-40a5-b29c-3e9dc2a994ac tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: 5184e752-c944-4ecd-a516-600944c18dc1] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:55:29.932324 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-91089d68-3f96-40a5-b29c-3e9dc2a994ac tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:29.933117 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-91089d68-3f96-40a5-b29c-3e9dc2a994ac tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:29.934778 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-91089d68-3f96-40a5-b29c-3e9dc2a994ac tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:29.935628 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-91089d68-3f96-40a5-b29c-3e9dc2a994ac tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:30.171671 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-91089d68-3f96-40a5-b29c-3e9dc2a994ac tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:30.192136 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-91089d68-3f96-40a5-b29c-3e9dc2a994ac tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:30.195973 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-91089d68-3f96-40a5-b29c-3e9dc2a994ac tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:30.197412 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-91089d68-3f96-40a5-b29c-3e9dc2a994ac tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1" status: 200 len: 1744 microversion: 2.20 time: 0.281682 May 12 14:55:30.210384 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 472/922] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:55:29 2022] GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1 => generated 1744 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:55:31.218002 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-9a15e197-118d-4da7-bafc-0c17cf313f9f tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:55:31.219403 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-9a15e197-118d-4da7-bafc-0c17cf313f9f tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: 5184e752-c944-4ecd-a516-600944c18dc1] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:55:31.229817 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-9a15e197-118d-4da7-bafc-0c17cf313f9f tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:31.229817 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-9a15e197-118d-4da7-bafc-0c17cf313f9f tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:31.230823 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-9a15e197-118d-4da7-bafc-0c17cf313f9f tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:31.231422 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-9a15e197-118d-4da7-bafc-0c17cf313f9f tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:31.633216 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-9a15e197-118d-4da7-bafc-0c17cf313f9f tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:31.644030 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-9a15e197-118d-4da7-bafc-0c17cf313f9f tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:31.645549 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-9a15e197-118d-4da7-bafc-0c17cf313f9f tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:31.646686 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-9a15e197-118d-4da7-bafc-0c17cf313f9f tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1" status: 200 len: 1739 microversion: 2.20 time: 0.432481 May 12 14:55:31.647275 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 451/923] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:55:31 2022] GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1 => generated 1739 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:55:31.789163 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-5b41a0e9-a515-476a-a6d8-8cacde8ad211 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:55:31.789677 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-5b41a0e9-a515-476a-a6d8-8cacde8ad211 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 59dadfa9-df81-4e69-aa33-d99984dbebfc] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:55:31.796750 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-5b41a0e9-a515-476a-a6d8-8cacde8ad211 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:31.797375 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-5b41a0e9-a515-476a-a6d8-8cacde8ad211 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:31.798142 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-5b41a0e9-a515-476a-a6d8-8cacde8ad211 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:31.798609 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-5b41a0e9-a515-476a-a6d8-8cacde8ad211 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:31.855957 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.wsgi [None req-5b41a0e9-a515-476a-a6d8-8cacde8ad211 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] HTTP exception thrown: Instance 59dadfa9-df81-4e69-aa33-d99984dbebfc could not be found. May 12 14:55:31.855957 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-5b41a0e9-a515-476a-a6d8-8cacde8ad211 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Returning 404 to user: Instance 59dadfa9-df81-4e69-aa33-d99984dbebfc could not be found. {{(pid=102213) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 12 14:55:31.855957 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-5b41a0e9-a515-476a-a6d8-8cacde8ad211 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "DELETE /compute/v2.1/servers/59dadfa9-df81-4e69-aa33-d99984dbebfc" status: 404 len: 111 microversion: 2.1 time: 0.067211 May 12 14:55:31.855957 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 473/924] 10.222.0.49 () {58 vars in 1238 bytes} [Thu May 12 14:55:31 2022] DELETE /compute/v2.1/servers/59dadfa9-df81-4e69-aa33-d99984dbebfc => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 14:55:31.863096 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-4ecab47d-2045-424f-9054-e62ddff18d15 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:55:31.863833 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-4ecab47d-2045-424f-9054-e62ddff18d15 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 59dadfa9-df81-4e69-aa33-d99984dbebfc] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:55:31.876977 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-4ecab47d-2045-424f-9054-e62ddff18d15 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:31.877669 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-4ecab47d-2045-424f-9054-e62ddff18d15 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:31.878784 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-4ecab47d-2045-424f-9054-e62ddff18d15 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:31.879429 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-4ecab47d-2045-424f-9054-e62ddff18d15 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:31.948973 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.wsgi [None req-4ecab47d-2045-424f-9054-e62ddff18d15 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] HTTP exception thrown: Instance 59dadfa9-df81-4e69-aa33-d99984dbebfc could not be found. May 12 14:55:31.949840 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-4ecab47d-2045-424f-9054-e62ddff18d15 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Returning 404 to user: Instance 59dadfa9-df81-4e69-aa33-d99984dbebfc could not be found. {{(pid=102212) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 12 14:55:31.951256 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-4ecab47d-2045-424f-9054-e62ddff18d15 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/59dadfa9-df81-4e69-aa33-d99984dbebfc" status: 404 len: 111 microversion: 2.1 time: 0.093230 May 12 14:55:31.952309 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 452/925] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:55:31 2022] GET /compute/v2.1/servers/59dadfa9-df81-4e69-aa33-d99984dbebfc => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 14:55:32.667084 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-12459df0-90bc-41f6-bb38-c7fd9cd79167 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:55:32.667734 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-12459df0-90bc-41f6-bb38-c7fd9cd79167 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: 5184e752-c944-4ecd-a516-600944c18dc1] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:55:32.682002 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-12459df0-90bc-41f6-bb38-c7fd9cd79167 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:32.682510 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-12459df0-90bc-41f6-bb38-c7fd9cd79167 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:32.683336 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-12459df0-90bc-41f6-bb38-c7fd9cd79167 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:32.684914 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-12459df0-90bc-41f6-bb38-c7fd9cd79167 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:32.949879 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [req-a19e9c39-5157-4a77-9f5f-811150b8368a req-4b43f2a6-355f-412d-a43f-b26ed4901fa5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5184e752-c944-4ecd-a516-600944c18dc1", "name": "network-vif-plugged", "status": "completed", "tag": "74c60ae0-11dc-4a5e-afb9-11e124615006"}]} {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:55:32.952840 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:55:32.952840 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: warnings.warn(msg) May 12 14:55:32.962240 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [req-a19e9c39-5157-4a77-9f5f-811150b8368a req-4b43f2a6-355f-412d-a43f-b26ed4901fa5 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:32.963096 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [req-a19e9c39-5157-4a77-9f5f-811150b8368a req-4b43f2a6-355f-412d-a43f-b26ed4901fa5 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:32.984386 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.compute.server_external_events [req-a19e9c39-5157-4a77-9f5f-811150b8368a req-4b43f2a6-355f-412d-a43f-b26ed4901fa5 service nova] Creating event network-vif-plugged:74c60ae0-11dc-4a5e-afb9-11e124615006 for instance 5184e752-c944-4ecd-a516-600944c18dc1 on hv-cinder-83118 May 12 14:55:32.991007 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [req-a19e9c39-5157-4a77-9f5f-811150b8368a req-4b43f2a6-355f-412d-a43f-b26ed4901fa5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045219 May 12 14:55:32.992359 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 453/926] 10.222.0.49 () {64 vars in 1317 bytes} [Thu May 12 14:55:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 14:55:33.152296 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-12459df0-90bc-41f6-bb38-c7fd9cd79167 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:33.164687 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-12459df0-90bc-41f6-bb38-c7fd9cd79167 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:33.166324 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-12459df0-90bc-41f6-bb38-c7fd9cd79167 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:33.167787 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-12459df0-90bc-41f6-bb38-c7fd9cd79167 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1" status: 200 len: 1739 microversion: 2.20 time: 0.505171 May 12 14:55:33.179131 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 474/927] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:55:32 2022] GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1 => generated 1739 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:55:33.530456 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-d0ff9443-add8-4665-a8bc-ea4f36593044 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:55:33.531381 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-d0ff9443-add8-4665-a8bc-ea4f36593044 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 6f7de537-3c2b-4b45-a0da-e5b9ab7c169a] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:55:33.540328 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-d0ff9443-add8-4665-a8bc-ea4f36593044 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:33.541202 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-d0ff9443-add8-4665-a8bc-ea4f36593044 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:33.542193 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-d0ff9443-add8-4665-a8bc-ea4f36593044 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:33.542785 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-d0ff9443-add8-4665-a8bc-ea4f36593044 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:33.644513 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.wsgi [None req-d0ff9443-add8-4665-a8bc-ea4f36593044 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] HTTP exception thrown: Instance 6f7de537-3c2b-4b45-a0da-e5b9ab7c169a could not be found. May 12 14:55:33.650085 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-d0ff9443-add8-4665-a8bc-ea4f36593044 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Returning 404 to user: Instance 6f7de537-3c2b-4b45-a0da-e5b9ab7c169a could not be found. {{(pid=102212) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 12 14:55:33.650962 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-d0ff9443-add8-4665-a8bc-ea4f36593044 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "DELETE /compute/v2.1/servers/6f7de537-3c2b-4b45-a0da-e5b9ab7c169a" status: 404 len: 111 microversion: 2.1 time: 0.125492 May 12 14:55:33.651525 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 454/928] 10.222.0.49 () {58 vars in 1238 bytes} [Thu May 12 14:55:33 2022] DELETE /compute/v2.1/servers/6f7de537-3c2b-4b45-a0da-e5b9ab7c169a => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 14:55:33.661950 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-b538a363-9389-46eb-926c-17e50e7bc977 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:55:33.663190 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-b538a363-9389-46eb-926c-17e50e7bc977 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 6f7de537-3c2b-4b45-a0da-e5b9ab7c169a] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:55:33.675646 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-b538a363-9389-46eb-926c-17e50e7bc977 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:33.676372 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-b538a363-9389-46eb-926c-17e50e7bc977 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:33.678267 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-b538a363-9389-46eb-926c-17e50e7bc977 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:33.678943 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-b538a363-9389-46eb-926c-17e50e7bc977 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:33.753442 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.wsgi [None req-b538a363-9389-46eb-926c-17e50e7bc977 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] HTTP exception thrown: Instance 6f7de537-3c2b-4b45-a0da-e5b9ab7c169a could not be found. May 12 14:55:33.754059 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-b538a363-9389-46eb-926c-17e50e7bc977 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Returning 404 to user: Instance 6f7de537-3c2b-4b45-a0da-e5b9ab7c169a could not be found. {{(pid=102213) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 12 14:55:33.754916 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-b538a363-9389-46eb-926c-17e50e7bc977 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/6f7de537-3c2b-4b45-a0da-e5b9ab7c169a" status: 404 len: 111 microversion: 2.1 time: 0.099102 May 12 14:55:33.755820 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 475/929] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:55:33 2022] GET /compute/v2.1/servers/6f7de537-3c2b-4b45-a0da-e5b9ab7c169a => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 14:55:33.764520 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-05b6dc06-d4a0-47be-9895-ceddec745317 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:55:33.768311 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-05b6dc06-d4a0-47be-9895-ceddec745317 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 84ccb759-1bc2-4810-8e46-e34c0c29a0d5] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:55:33.775319 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-05b6dc06-d4a0-47be-9895-ceddec745317 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:33.775771 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-05b6dc06-d4a0-47be-9895-ceddec745317 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:33.776548 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-05b6dc06-d4a0-47be-9895-ceddec745317 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:33.776977 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-05b6dc06-d4a0-47be-9895-ceddec745317 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:33.836710 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.wsgi [None req-05b6dc06-d4a0-47be-9895-ceddec745317 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] HTTP exception thrown: Instance 84ccb759-1bc2-4810-8e46-e34c0c29a0d5 could not be found. May 12 14:55:33.837502 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-05b6dc06-d4a0-47be-9895-ceddec745317 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Returning 404 to user: Instance 84ccb759-1bc2-4810-8e46-e34c0c29a0d5 could not be found. {{(pid=102212) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 12 14:55:33.838499 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-05b6dc06-d4a0-47be-9895-ceddec745317 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "DELETE /compute/v2.1/servers/84ccb759-1bc2-4810-8e46-e34c0c29a0d5" status: 404 len: 111 microversion: 2.1 time: 0.078641 May 12 14:55:33.840772 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 455/930] 10.222.0.49 () {58 vars in 1238 bytes} [Thu May 12 14:55:33 2022] DELETE /compute/v2.1/servers/84ccb759-1bc2-4810-8e46-e34c0c29a0d5 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 12 14:55:33.853718 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-f2de2507-c413-483d-8a60-7f3c7542edd5 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:55:33.854603 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-f2de2507-c413-483d-8a60-7f3c7542edd5 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 84ccb759-1bc2-4810-8e46-e34c0c29a0d5] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:55:33.862803 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-f2de2507-c413-483d-8a60-7f3c7542edd5 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:33.863460 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-f2de2507-c413-483d-8a60-7f3c7542edd5 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:33.864255 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-f2de2507-c413-483d-8a60-7f3c7542edd5 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:33.864856 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-f2de2507-c413-483d-8a60-7f3c7542edd5 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:33.928538 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.wsgi [None req-f2de2507-c413-483d-8a60-7f3c7542edd5 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] HTTP exception thrown: Instance 84ccb759-1bc2-4810-8e46-e34c0c29a0d5 could not be found. May 12 14:55:33.929444 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-f2de2507-c413-483d-8a60-7f3c7542edd5 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Returning 404 to user: Instance 84ccb759-1bc2-4810-8e46-e34c0c29a0d5 could not be found. {{(pid=102213) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 12 14:55:33.930427 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-f2de2507-c413-483d-8a60-7f3c7542edd5 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/84ccb759-1bc2-4810-8e46-e34c0c29a0d5" status: 404 len: 111 microversion: 2.1 time: 0.080657 May 12 14:55:33.931627 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 476/931] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:55:33 2022] GET /compute/v2.1/servers/84ccb759-1bc2-4810-8e46-e34c0c29a0d5 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 14:55:34.186531 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-394f3e2d-3d34-468f-98cb-45b5959d89e9 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:55:34.187196 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-394f3e2d-3d34-468f-98cb-45b5959d89e9 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: 5184e752-c944-4ecd-a516-600944c18dc1] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:55:34.196460 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-394f3e2d-3d34-468f-98cb-45b5959d89e9 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:34.197151 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-394f3e2d-3d34-468f-98cb-45b5959d89e9 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:34.198088 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-394f3e2d-3d34-468f-98cb-45b5959d89e9 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:34.198689 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-394f3e2d-3d34-468f-98cb-45b5959d89e9 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:34.542741 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-394f3e2d-3d34-468f-98cb-45b5959d89e9 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:34.555161 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-394f3e2d-3d34-468f-98cb-45b5959d89e9 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:34.556842 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-394f3e2d-3d34-468f-98cb-45b5959d89e9 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:34.560185 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-394f3e2d-3d34-468f-98cb-45b5959d89e9 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1" status: 200 len: 1739 microversion: 2.20 time: 0.375526 May 12 14:55:34.560185 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 456/932] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:55:34 2022] GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1 => generated 1739 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:55:35.505608 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-953a3e65-73e7-493f-b00b-2c31bb9be818 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:55:35.506110 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-953a3e65-73e7-493f-b00b-2c31bb9be818 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:55:35.513385 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-953a3e65-73e7-493f-b00b-2c31bb9be818 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:35.513839 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-953a3e65-73e7-493f-b00b-2c31bb9be818 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:35.514630 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-953a3e65-73e7-493f-b00b-2c31bb9be818 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:35.515092 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-953a3e65-73e7-493f-b00b-2c31bb9be818 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:35.567970 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.wsgi [None req-953a3e65-73e7-493f-b00b-2c31bb9be818 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] HTTP exception thrown: Instance 64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7 could not be found. May 12 14:55:35.568757 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-953a3e65-73e7-493f-b00b-2c31bb9be818 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Returning 404 to user: Instance 64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7 could not be found. {{(pid=102213) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 12 14:55:35.569875 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-953a3e65-73e7-493f-b00b-2c31bb9be818 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "DELETE /compute/v2.1/servers/64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7" status: 404 len: 111 microversion: 2.1 time: 0.067846 May 12 14:55:35.570622 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 477/933] 10.222.0.49 () {58 vars in 1238 bytes} [Thu May 12 14:55:35 2022] DELETE /compute/v2.1/servers/64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 14:55:35.579201 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-b240bb97-0c82-4cd6-b33f-5838fdd962dc tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:55:35.580032 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-b240bb97-0c82-4cd6-b33f-5838fdd962dc tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: 5184e752-c944-4ecd-a516-600944c18dc1] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:55:35.580139 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-aefbe9e7-2322-40f5-8c3f-ee6924991719 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:55:35.580971 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-aefbe9e7-2322-40f5-8c3f-ee6924991719 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] [instance: 64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:55:35.587990 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-b240bb97-0c82-4cd6-b33f-5838fdd962dc tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:35.588524 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-b240bb97-0c82-4cd6-b33f-5838fdd962dc tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:35.589416 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-aefbe9e7-2322-40f5-8c3f-ee6924991719 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:35.589652 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-b240bb97-0c82-4cd6-b33f-5838fdd962dc tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:35.589889 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-aefbe9e7-2322-40f5-8c3f-ee6924991719 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:35.590488 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-b240bb97-0c82-4cd6-b33f-5838fdd962dc tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:35.590683 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-aefbe9e7-2322-40f5-8c3f-ee6924991719 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:35.591316 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-aefbe9e7-2322-40f5-8c3f-ee6924991719 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:35.643483 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.wsgi [None req-aefbe9e7-2322-40f5-8c3f-ee6924991719 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] HTTP exception thrown: Instance 64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7 could not be found. May 12 14:55:35.644262 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-aefbe9e7-2322-40f5-8c3f-ee6924991719 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] Returning 404 to user: Instance 64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7 could not be found. {{(pid=102213) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 12 14:55:35.645185 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-aefbe9e7-2322-40f5-8c3f-ee6924991719 tempest-AttachVolumeNegativeTest-715688681 tempest-AttachVolumeNegativeTest-715688681-project] 10.222.0.49 "GET /compute/v2.1/servers/64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7" status: 404 len: 111 microversion: 2.1 time: 0.069980 May 12 14:55:35.646076 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 478/934] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:55:35 2022] GET /compute/v2.1/servers/64cd0c6d-ffac-47f0-848e-d59c3b7b1ee7 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 12 14:55:35.797007 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-b240bb97-0c82-4cd6-b33f-5838fdd962dc tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:35.819758 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-b240bb97-0c82-4cd6-b33f-5838fdd962dc tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:35.819758 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-b240bb97-0c82-4cd6-b33f-5838fdd962dc tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:35.820001 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-b240bb97-0c82-4cd6-b33f-5838fdd962dc tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1" status: 200 len: 1739 microversion: 2.20 time: 0.244848 May 12 14:55:35.820553 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 457/935] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:55:35 2022] GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1 => generated 1739 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:55:36.839853 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-ac792faa-4c25-4f0d-be9c-dff63dfca1e9 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:55:36.841109 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-ac792faa-4c25-4f0d-be9c-dff63dfca1e9 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: 5184e752-c944-4ecd-a516-600944c18dc1] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:55:36.855360 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-ac792faa-4c25-4f0d-be9c-dff63dfca1e9 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:36.857550 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-ac792faa-4c25-4f0d-be9c-dff63dfca1e9 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:36.859694 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-ac792faa-4c25-4f0d-be9c-dff63dfca1e9 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:36.860871 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-ac792faa-4c25-4f0d-be9c-dff63dfca1e9 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:37.219451 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-ac792faa-4c25-4f0d-be9c-dff63dfca1e9 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:37.233259 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-ac792faa-4c25-4f0d-be9c-dff63dfca1e9 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:37.237608 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-ac792faa-4c25-4f0d-be9c-dff63dfca1e9 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:37.244372 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-ac792faa-4c25-4f0d-be9c-dff63dfca1e9 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1" status: 200 len: 1739 microversion: 2.20 time: 0.409149 May 12 14:55:37.245415 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 479/936] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:55:36 2022] GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1 => generated 1739 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:55:38.263022 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-c661c987-5d74-4fb1-8efd-6f8948888e8b tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:55:38.268780 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-c661c987-5d74-4fb1-8efd-6f8948888e8b tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: 5184e752-c944-4ecd-a516-600944c18dc1] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:55:38.276621 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-c661c987-5d74-4fb1-8efd-6f8948888e8b tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:38.277490 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-c661c987-5d74-4fb1-8efd-6f8948888e8b tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:38.278538 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-c661c987-5d74-4fb1-8efd-6f8948888e8b tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:38.285560 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-c661c987-5d74-4fb1-8efd-6f8948888e8b tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:38.628163 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-c661c987-5d74-4fb1-8efd-6f8948888e8b tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:38.649290 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-c661c987-5d74-4fb1-8efd-6f8948888e8b tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:38.651362 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-c661c987-5d74-4fb1-8efd-6f8948888e8b tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:38.652866 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-c661c987-5d74-4fb1-8efd-6f8948888e8b tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1" status: 200 len: 1739 microversion: 2.20 time: 0.393571 May 12 14:55:38.653920 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 458/937] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:55:38 2022] GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1 => generated 1739 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:55:39.673567 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-f88103cd-edd6-4b8a-bda7-ae5a6a2dd33b tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:55:39.674182 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-f88103cd-edd6-4b8a-bda7-ae5a6a2dd33b tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: 5184e752-c944-4ecd-a516-600944c18dc1] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:55:39.683008 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-f88103cd-edd6-4b8a-bda7-ae5a6a2dd33b tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:39.683632 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-f88103cd-edd6-4b8a-bda7-ae5a6a2dd33b tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:39.683824 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-f88103cd-edd6-4b8a-bda7-ae5a6a2dd33b tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:39.684233 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-f88103cd-edd6-4b8a-bda7-ae5a6a2dd33b tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:39.958829 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-f88103cd-edd6-4b8a-bda7-ae5a6a2dd33b tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:39.971900 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-f88103cd-edd6-4b8a-bda7-ae5a6a2dd33b tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:39.973796 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-f88103cd-edd6-4b8a-bda7-ae5a6a2dd33b tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:39.975322 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-f88103cd-edd6-4b8a-bda7-ae5a6a2dd33b tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1" status: 200 len: 1739 microversion: 2.20 time: 0.305446 May 12 14:55:39.976450 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 480/938] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:55:39 2022] GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1 => generated 1739 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:55:40.995603 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-d8e38649-22f8-437b-8f67-b159eee2dbbb tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:55:40.997633 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-d8e38649-22f8-437b-8f67-b159eee2dbbb tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: 5184e752-c944-4ecd-a516-600944c18dc1] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:55:41.008722 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-d8e38649-22f8-437b-8f67-b159eee2dbbb tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:41.009494 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-d8e38649-22f8-437b-8f67-b159eee2dbbb tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:41.010532 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-d8e38649-22f8-437b-8f67-b159eee2dbbb tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:41.011225 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-d8e38649-22f8-437b-8f67-b159eee2dbbb tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:41.469524 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-d8e38649-22f8-437b-8f67-b159eee2dbbb tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:41.481936 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-d8e38649-22f8-437b-8f67-b159eee2dbbb tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:41.488213 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-d8e38649-22f8-437b-8f67-b159eee2dbbb tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:41.495404 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-d8e38649-22f8-437b-8f67-b159eee2dbbb tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1" status: 200 len: 1739 microversion: 2.20 time: 0.503635 May 12 14:55:41.498115 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 459/939] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:55:40 2022] GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1 => generated 1739 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:55:42.520423 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-59921e9b-03d3-4908-a0f2-900c1519a009 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:55:42.523381 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-59921e9b-03d3-4908-a0f2-900c1519a009 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: 5184e752-c944-4ecd-a516-600944c18dc1] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:55:42.544660 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-59921e9b-03d3-4908-a0f2-900c1519a009 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:42.548060 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-59921e9b-03d3-4908-a0f2-900c1519a009 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:42.549707 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-59921e9b-03d3-4908-a0f2-900c1519a009 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:42.550360 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-59921e9b-03d3-4908-a0f2-900c1519a009 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:43.225578 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-59921e9b-03d3-4908-a0f2-900c1519a009 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:43.237201 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-59921e9b-03d3-4908-a0f2-900c1519a009 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:43.264679 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-59921e9b-03d3-4908-a0f2-900c1519a009 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:43.264679 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-59921e9b-03d3-4908-a0f2-900c1519a009 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1" status: 200 len: 1739 microversion: 2.20 time: 0.732743 May 12 14:55:43.264679 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 481/940] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:55:42 2022] GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1 => generated 1739 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:55:44.273530 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-d41ea7f7-f795-40c4-b44b-2cefc73199e3 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:55:44.276601 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-d41ea7f7-f795-40c4-b44b-2cefc73199e3 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: 5184e752-c944-4ecd-a516-600944c18dc1] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:55:44.283189 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-d41ea7f7-f795-40c4-b44b-2cefc73199e3 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:44.283927 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-d41ea7f7-f795-40c4-b44b-2cefc73199e3 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:44.285004 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-d41ea7f7-f795-40c4-b44b-2cefc73199e3 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:44.285442 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-d41ea7f7-f795-40c4-b44b-2cefc73199e3 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:44.503913 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-d41ea7f7-f795-40c4-b44b-2cefc73199e3 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:44.512934 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-d41ea7f7-f795-40c4-b44b-2cefc73199e3 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:44.514717 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-d41ea7f7-f795-40c4-b44b-2cefc73199e3 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:44.516164 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-d41ea7f7-f795-40c4-b44b-2cefc73199e3 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1" status: 200 len: 1739 microversion: 2.20 time: 0.246753 May 12 14:55:44.516720 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 460/941] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:55:44 2022] GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1 => generated 1739 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:55:45.534945 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-374b1110-6229-498b-b711-4005343132a8 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:55:45.535543 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-374b1110-6229-498b-b711-4005343132a8 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: 5184e752-c944-4ecd-a516-600944c18dc1] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:55:45.542755 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-374b1110-6229-498b-b711-4005343132a8 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:45.543244 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-374b1110-6229-498b-b711-4005343132a8 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:45.544017 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-374b1110-6229-498b-b711-4005343132a8 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:45.544446 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-374b1110-6229-498b-b711-4005343132a8 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:45.761478 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-374b1110-6229-498b-b711-4005343132a8 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:45.771261 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-374b1110-6229-498b-b711-4005343132a8 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:45.772794 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-374b1110-6229-498b-b711-4005343132a8 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:45.773929 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-374b1110-6229-498b-b711-4005343132a8 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1" status: 200 len: 1739 microversion: 2.20 time: 0.243820 May 12 14:55:45.774847 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 482/942] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:55:45 2022] GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1 => generated 1739 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:55:46.792645 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-68f955de-4fe2-44d6-af9b-6252dbfc7d74 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:55:46.793966 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-68f955de-4fe2-44d6-af9b-6252dbfc7d74 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: 5184e752-c944-4ecd-a516-600944c18dc1] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:55:46.801453 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-68f955de-4fe2-44d6-af9b-6252dbfc7d74 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:46.802222 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-68f955de-4fe2-44d6-af9b-6252dbfc7d74 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:46.803212 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-68f955de-4fe2-44d6-af9b-6252dbfc7d74 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:46.803876 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-68f955de-4fe2-44d6-af9b-6252dbfc7d74 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:47.211254 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-68f955de-4fe2-44d6-af9b-6252dbfc7d74 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:47.230416 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-68f955de-4fe2-44d6-af9b-6252dbfc7d74 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:47.230416 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-68f955de-4fe2-44d6-af9b-6252dbfc7d74 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:47.231316 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-68f955de-4fe2-44d6-af9b-6252dbfc7d74 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1" status: 200 len: 1721 microversion: 2.20 time: 0.442328 May 12 14:55:47.231877 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 461/943] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:55:46 2022] GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1 => generated 1721 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 14:55:48.249354 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-5e8ce14d-1c63-48ad-9830-b54022c534d9 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:55:48.250129 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-5e8ce14d-1c63-48ad-9830-b54022c534d9 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: 5184e752-c944-4ecd-a516-600944c18dc1] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:55:48.258204 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-5e8ce14d-1c63-48ad-9830-b54022c534d9 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:48.258737 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-5e8ce14d-1c63-48ad-9830-b54022c534d9 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:48.259527 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-5e8ce14d-1c63-48ad-9830-b54022c534d9 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:48.259950 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-5e8ce14d-1c63-48ad-9830-b54022c534d9 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:48.469730 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-5e8ce14d-1c63-48ad-9830-b54022c534d9 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:48.479017 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-5e8ce14d-1c63-48ad-9830-b54022c534d9 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:48.480523 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-5e8ce14d-1c63-48ad-9830-b54022c534d9 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:48.481649 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-5e8ce14d-1c63-48ad-9830-b54022c534d9 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1" status: 200 len: 1721 microversion: 2.20 time: 0.236003 May 12 14:55:48.482208 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 483/944] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:55:48 2022] GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1 => generated 1721 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:55:48.799239 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [req-c181c5f9-00d0-49b9-9760-37c6382229ad req-d9d7e202-86d2-494d-9ee8-d55e1c0c11cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5184e752-c944-4ecd-a516-600944c18dc1", "name": "network-vif-unplugged", "status": "completed", "tag": "74c60ae0-11dc-4a5e-afb9-11e124615006"}]} {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:55:48.800759 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:55:48.800759 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: warnings.warn(msg) May 12 14:55:48.808982 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [req-c181c5f9-00d0-49b9-9760-37c6382229ad req-d9d7e202-86d2-494d-9ee8-d55e1c0c11cc service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:48.809456 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [req-c181c5f9-00d0-49b9-9760-37c6382229ad req-d9d7e202-86d2-494d-9ee8-d55e1c0c11cc service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:48.825962 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.compute.server_external_events [req-c181c5f9-00d0-49b9-9760-37c6382229ad req-d9d7e202-86d2-494d-9ee8-d55e1c0c11cc service nova] Creating event network-vif-unplugged:74c60ae0-11dc-4a5e-afb9-11e124615006 for instance 5184e752-c944-4ecd-a516-600944c18dc1 on hv-cinder-83118 May 12 14:55:48.831371 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [req-c181c5f9-00d0-49b9-9760-37c6382229ad req-d9d7e202-86d2-494d-9ee8-d55e1c0c11cc service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035876 May 12 14:55:48.832022 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 462/945] 10.222.0.49 () {64 vars in 1317 bytes} [Thu May 12 14:55:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:55:49.220339 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-f82b4535-8a1e-4f7b-b1e3-d835b8be921c tempest-VolumesTestJSON-1163361084 tempest-VolumesTestJSON-1163361084-project] Calling method '.version_select at 0x7ff77e9af1f0>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:55:49.300897 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-f82b4535-8a1e-4f7b-b1e3-d835b8be921c tempest-VolumesTestJSON-1163361084 tempest-VolumesTestJSON-1163361084-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/d38c3be9-ef7d-4e19-8564-e1f94e6f1933" status: 200 len: 351 microversion: 2.1 time: 0.084547 May 12 14:55:49.302668 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 484/946] 10.222.0.49 () {58 vars in 1244 bytes} [Thu May 12 14:55:49 2022] GET /compute/v2.1/os-volumes/d38c3be9-ef7d-4e19-8564-e1f94e6f1933 => generated 351 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:55:49.500499 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-afe7a8b4-cc12-4262-a961-2071100cf860 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:55:49.501741 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-afe7a8b4-cc12-4262-a961-2071100cf860 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: 5184e752-c944-4ecd-a516-600944c18dc1] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:55:49.509290 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-afe7a8b4-cc12-4262-a961-2071100cf860 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:49.509741 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-afe7a8b4-cc12-4262-a961-2071100cf860 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:49.510512 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-afe7a8b4-cc12-4262-a961-2071100cf860 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:49.510976 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-afe7a8b4-cc12-4262-a961-2071100cf860 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:49.736504 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-afe7a8b4-cc12-4262-a961-2071100cf860 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:49.746477 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-afe7a8b4-cc12-4262-a961-2071100cf860 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:49.748295 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-afe7a8b4-cc12-4262-a961-2071100cf860 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:49.749537 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-afe7a8b4-cc12-4262-a961-2071100cf860 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1" status: 200 len: 1721 microversion: 2.20 time: 0.253126 May 12 14:55:49.750459 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 463/947] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:55:49 2022] GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1 => generated 1721 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:55:50.768170 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-32c81ad3-cbd9-4910-836e-11bbbe5aee70 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:55:50.768803 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-32c81ad3-cbd9-4910-836e-11bbbe5aee70 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: 5184e752-c944-4ecd-a516-600944c18dc1] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:55:50.776013 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-32c81ad3-cbd9-4910-836e-11bbbe5aee70 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:50.776456 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-32c81ad3-cbd9-4910-836e-11bbbe5aee70 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:50.777211 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-32c81ad3-cbd9-4910-836e-11bbbe5aee70 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:50.777658 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-32c81ad3-cbd9-4910-836e-11bbbe5aee70 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:50.976304 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-32c81ad3-cbd9-4910-836e-11bbbe5aee70 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:50.984879 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-32c81ad3-cbd9-4910-836e-11bbbe5aee70 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:50.986396 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-32c81ad3-cbd9-4910-836e-11bbbe5aee70 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:50.987600 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-32c81ad3-cbd9-4910-836e-11bbbe5aee70 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1" status: 200 len: 1724 microversion: 2.20 time: 0.223334 May 12 14:55:50.988141 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 485/948] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:55:50 2022] GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1 => generated 1724 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:55:51.004883 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-849440cb-7fc1-4bee-8931-1b9d2f7ce497 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5b5e2c7a-26c8-434f-aeed-53659b602ac6"}} {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:55:51.005947 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-849440cb-7fc1-4bee-8931-1b9d2f7ce497 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: 5184e752-c944-4ecd-a516-600944c18dc1] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:55:51.013138 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-849440cb-7fc1-4bee-8931-1b9d2f7ce497 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:51.013593 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-849440cb-7fc1-4bee-8931-1b9d2f7ce497 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:51.014602 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-849440cb-7fc1-4bee-8931-1b9d2f7ce497 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:51.015067 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-849440cb-7fc1-4bee-8931-1b9d2f7ce497 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:52.762331 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-849440cb-7fc1-4bee-8931-1b9d2f7ce497 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "POST /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.761291 May 12 14:55:52.768340 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 464/949] 10.222.0.49 () {62 vars in 1363 bytes} [Thu May 12 14:55:50 2022] POST /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1/os-volume_attachments => generated 188 bytes in 1763 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 12 14:55:52.949150 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-888df72c-e79b-4d2a-b0b3-315478e1c48b tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:55:52.950001 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-888df72c-e79b-4d2a-b0b3-315478e1c48b tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: 5184e752-c944-4ecd-a516-600944c18dc1] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:55:52.961704 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-888df72c-e79b-4d2a-b0b3-315478e1c48b tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:52.962154 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-888df72c-e79b-4d2a-b0b3-315478e1c48b tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:52.962966 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-888df72c-e79b-4d2a-b0b3-315478e1c48b tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:52.963382 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-888df72c-e79b-4d2a-b0b3-315478e1c48b tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:53.432427 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-88b69c5d-3ac2-4d25-b67d-9c6c61feef82 tempest-VolumesTestJSON-1163361084 tempest-VolumesTestJSON-1163361084-project] Calling method '.version_select at 0x7ff78047f940>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:55:53.511809 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-88b69c5d-3ac2-4d25-b67d-9c6c61feef82 tempest-VolumesTestJSON-1163361084 tempest-VolumesTestJSON-1163361084-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/04bc8271-7f1a-4999-a568-6221fe2c07ec" status: 200 len: 350 microversion: 2.1 time: 0.082954 May 12 14:55:53.512487 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 465/950] 10.222.0.49 () {58 vars in 1244 bytes} [Thu May 12 14:55:53 2022] GET /compute/v2.1/os-volumes/04bc8271-7f1a-4999-a568-6221fe2c07ec => generated 350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 14:55:53.942004 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-888df72c-e79b-4d2a-b0b3-315478e1c48b tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "DELETE /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1/os-volume_attachments/5b5e2c7a-26c8-434f-aeed-53659b602ac6" status: 202 len: 0 microversion: 2.20 time: 0.997953 May 12 14:55:53.942635 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 486/951] 10.222.0.49 () {60 vars in 1456 bytes} [Thu May 12 14:55:52 2022] DELETE /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1/os-volume_attachments/5b5e2c7a-26c8-434f-aeed-53659b602ac6 => generated 0 bytes in 999 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 12 14:55:54.495031 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-d5d42b4a-9469-459a-af82-7a02fa5058a8 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:55:54.495604 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-d5d42b4a-9469-459a-af82-7a02fa5058a8 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: 5184e752-c944-4ecd-a516-600944c18dc1] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:55:54.503398 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-d5d42b4a-9469-459a-af82-7a02fa5058a8 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:54.503848 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-d5d42b4a-9469-459a-af82-7a02fa5058a8 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:54.504616 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-d5d42b4a-9469-459a-af82-7a02fa5058a8 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:54.505051 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-d5d42b4a-9469-459a-af82-7a02fa5058a8 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:54.869676 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-d5d42b4a-9469-459a-af82-7a02fa5058a8 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "POST /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1/action" status: 202 len: 0 microversion: 2.20 time: 0.378337 May 12 14:55:54.870661 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 466/952] 10.222.0.49 () {62 vars in 1318 bytes} [Thu May 12 14:55:54 2022] POST /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1/action => generated 0 bytes in 380 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 12 14:55:54.879492 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-935103a3-b10c-495c-91a0-11b1ec67f6ad tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:55:54.880219 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-935103a3-b10c-495c-91a0-11b1ec67f6ad tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: 5184e752-c944-4ecd-a516-600944c18dc1] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:55:54.887710 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-935103a3-b10c-495c-91a0-11b1ec67f6ad tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:54.888151 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-935103a3-b10c-495c-91a0-11b1ec67f6ad tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:54.888948 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-935103a3-b10c-495c-91a0-11b1ec67f6ad tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:54.889572 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-935103a3-b10c-495c-91a0-11b1ec67f6ad tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:55.094165 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-935103a3-b10c-495c-91a0-11b1ec67f6ad tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:55.102965 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-935103a3-b10c-495c-91a0-11b1ec67f6ad tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:55.104466 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-935103a3-b10c-495c-91a0-11b1ec67f6ad tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:55.105589 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-935103a3-b10c-495c-91a0-11b1ec67f6ad tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1" status: 200 len: 1672 microversion: 2.20 time: 0.230907 May 12 14:55:55.106134 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 487/953] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:55:54 2022] GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1 => generated 1672 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 14:55:56.123951 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-682182af-25b0-4f25-bba8-bf2389f72ecd tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:55:56.124565 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-682182af-25b0-4f25-bba8-bf2389f72ecd tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: 5184e752-c944-4ecd-a516-600944c18dc1] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:55:56.132621 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-682182af-25b0-4f25-bba8-bf2389f72ecd tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:56.133078 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-682182af-25b0-4f25-bba8-bf2389f72ecd tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:56.133848 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-682182af-25b0-4f25-bba8-bf2389f72ecd tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:56.134288 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-682182af-25b0-4f25-bba8-bf2389f72ecd tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:56.330700 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-682182af-25b0-4f25-bba8-bf2389f72ecd tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:56.339467 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-682182af-25b0-4f25-bba8-bf2389f72ecd tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:56.340978 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-682182af-25b0-4f25-bba8-bf2389f72ecd tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:56.342116 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-682182af-25b0-4f25-bba8-bf2389f72ecd tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1" status: 200 len: 1672 microversion: 2.20 time: 0.222121 May 12 14:55:56.342910 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 467/954] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:55:56 2022] GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1 => generated 1672 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:55:57.362206 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-b3f1b028-54de-494c-883b-4fb38e31f8de tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:55:57.362848 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-b3f1b028-54de-494c-883b-4fb38e31f8de tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: 5184e752-c944-4ecd-a516-600944c18dc1] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:55:57.370139 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-b3f1b028-54de-494c-883b-4fb38e31f8de tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:57.370587 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-b3f1b028-54de-494c-883b-4fb38e31f8de tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:57.371393 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-b3f1b028-54de-494c-883b-4fb38e31f8de tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:57.371830 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-b3f1b028-54de-494c-883b-4fb38e31f8de tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:57.573737 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-b3f1b028-54de-494c-883b-4fb38e31f8de tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:57.582244 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-b3f1b028-54de-494c-883b-4fb38e31f8de tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:57.583770 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-b3f1b028-54de-494c-883b-4fb38e31f8de tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:57.584957 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-b3f1b028-54de-494c-883b-4fb38e31f8de tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1" status: 200 len: 1672 microversion: 2.20 time: 0.227212 May 12 14:55:57.585508 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 488/955] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:55:57 2022] GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1 => generated 1672 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:55:58.601828 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-1ba7c39d-9749-42eb-9f6a-a21a9318c510 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:55:58.602468 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-1ba7c39d-9749-42eb-9f6a-a21a9318c510 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: 5184e752-c944-4ecd-a516-600944c18dc1] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:55:58.609928 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-1ba7c39d-9749-42eb-9f6a-a21a9318c510 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:58.610967 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-1ba7c39d-9749-42eb-9f6a-a21a9318c510 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:58.611750 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-1ba7c39d-9749-42eb-9f6a-a21a9318c510 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:58.612188 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-1ba7c39d-9749-42eb-9f6a-a21a9318c510 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:58.900004 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-886019f2-400a-44c1-b92b-5c3621b39c25 tempest-VolumesTestJSON-1163361084 tempest-VolumesTestJSON-1163361084-project] Calling method '.version_select at 0x7ff77eaf1c10>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:55:58.935689 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-1ba7c39d-9749-42eb-9f6a-a21a9318c510 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:58.944400 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-1ba7c39d-9749-42eb-9f6a-a21a9318c510 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:58.945917 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-1ba7c39d-9749-42eb-9f6a-a21a9318c510 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:55:58.947090 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-1ba7c39d-9749-42eb-9f6a-a21a9318c510 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1" status: 200 len: 1730 microversion: 2.20 time: 0.348995 May 12 14:55:58.949890 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 468/956] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:55:58 2022] GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1 => generated 1730 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:55:58.981735 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-886019f2-400a-44c1-b92b-5c3621b39c25 tempest-VolumesTestJSON-1163361084 tempest-VolumesTestJSON-1163361084-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/55549deb-6866-4d3e-9f6e-ceed113b5981" status: 200 len: 351 microversion: 2.1 time: 0.085262 May 12 14:55:58.988357 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 489/957] 10.222.0.49 () {58 vars in 1244 bytes} [Thu May 12 14:55:58 2022] GET /compute/v2.1/os-volumes/55549deb-6866-4d3e-9f6e-ceed113b5981 => generated 351 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:55:58.998105 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-3c9143a4-60ee-45d7-a1dd-1ff0e2b6e70d tempest-VolumesTestJSON-1163361084 tempest-VolumesTestJSON-1163361084-project] Calling method '.version_select at 0x7ff77fb5ea60>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:55:59.135748 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-3c9143a4-60ee-45d7-a1dd-1ff0e2b6e70d tempest-VolumesTestJSON-1163361084 tempest-VolumesTestJSON-1163361084-project] 10.222.0.49 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.141153 May 12 14:55:59.136614 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 469/958] 10.222.0.49 () {58 vars in 1133 bytes} [Thu May 12 14:55:58 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:55:59.151318 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-ca7d97d8-67fe-4592-8eea-26881dda321c tempest-VolumesTestJSON-1163361084 tempest-VolumesTestJSON-1163361084-project] Calling method '.version_select at 0x7ff77e811040>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:55:59.306264 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-ca7d97d8-67fe-4592-8eea-26881dda321c tempest-VolumesTestJSON-1163361084 tempest-VolumesTestJSON-1163361084-project] 10.222.0.49 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.160885 May 12 14:55:59.306929 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 490/959] 10.222.0.49 () {58 vars in 1148 bytes} [Thu May 12 14:55:59 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:55:59.319211 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-5b43f360-431d-47da-9d99-a3eb29056f72 tempest-VolumesTestJSON-1163361084 tempest-VolumesTestJSON-1163361084-project] Calling method '.version_select at 0x7ff77e5493a0>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:55:59.605261 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-5b43f360-431d-47da-9d99-a3eb29056f72 tempest-VolumesTestJSON-1163361084 tempest-VolumesTestJSON-1163361084-project] 10.222.0.49 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.289870 May 12 14:55:59.612412 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 470/960] 10.222.0.49 () {58 vars in 1133 bytes} [Thu May 12 14:55:59 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:55:59.617067 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-baee31ec-c138-4f51-a671-bca1d777c644 tempest-VolumesTestJSON-1163361084 tempest-VolumesTestJSON-1163361084-project] Calling method '.version_select at 0x7ff77eaf0700>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:55:59.702038 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-baee31ec-c138-4f51-a671-bca1d777c644 tempest-VolumesTestJSON-1163361084 tempest-VolumesTestJSON-1163361084-project] 10.222.0.49 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.088448 May 12 14:55:59.702619 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 491/961] 10.222.0.49 () {58 vars in 1166 bytes} [Thu May 12 14:55:59 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:55:59.717412 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-77730489-c65b-4b6b-b2da-e8b9e971b531 tempest-VolumesTestJSON-1163361084 tempest-VolumesTestJSON-1163361084-project] Calling method '.version_select at 0x7ff77e525700>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:55:59.800603 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-77730489-c65b-4b6b-b2da-e8b9e971b531 tempest-VolumesTestJSON-1163361084 tempest-VolumesTestJSON-1163361084-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.089248 May 12 14:55:59.801174 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 471/962] 10.222.0.49 () {58 vars in 1169 bytes} [Thu May 12 14:55:59 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:55:59.812984 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-4273594e-7b08-4da0-a96f-a2f9ff056541 tempest-VolumesTestJSON-1163361084 tempest-VolumesTestJSON-1163361084-project] Calling method '.version_select at 0x7ff77eaf0820>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:55:59.895823 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-4273594e-7b08-4da0-a96f-a2f9ff056541 tempest-VolumesTestJSON-1163361084 tempest-VolumesTestJSON-1163361084-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.086694 May 12 14:55:59.896393 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 492/963] 10.222.0.49 () {58 vars in 1154 bytes} [Thu May 12 14:55:59 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:55:59.907627 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-7b36261f-5d81-419e-9036-fc56b6007d43 tempest-VolumesTestJSON-1163361084 tempest-VolumesTestJSON-1163361084-project] Calling method '.version_select at 0x7ff77e525af0>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:55:59.965293 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-ec18c8db-1b7b-46a4-b08c-07505ccfdbb5 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:55:59.966002 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-ec18c8db-1b7b-46a4-b08c-07505ccfdbb5 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: 5184e752-c944-4ecd-a516-600944c18dc1] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:55:59.973875 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-ec18c8db-1b7b-46a4-b08c-07505ccfdbb5 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:59.980792 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-ec18c8db-1b7b-46a4-b08c-07505ccfdbb5 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:59.980792 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-ec18c8db-1b7b-46a4-b08c-07505ccfdbb5 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:55:59.980792 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-ec18c8db-1b7b-46a4-b08c-07505ccfdbb5 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:55:59.991137 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-7b36261f-5d81-419e-9036-fc56b6007d43 tempest-VolumesTestJSON-1163361084 tempest-VolumesTestJSON-1163361084-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.087520 May 12 14:55:59.991740 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 472/964] 10.222.0.49 () {58 vars in 1187 bytes} [Thu May 12 14:55:59 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:56:00.003822 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-812a4593-b292-4ce6-985a-415a084bc9ca tempest-VolumesTestJSON-1163361084 tempest-VolumesTestJSON-1163361084-project] Calling method '.version_select at 0x7ff77fbdbdc0>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:56:00.100676 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-812a4593-b292-4ce6-985a-415a084bc9ca tempest-VolumesTestJSON-1163361084 tempest-VolumesTestJSON-1163361084-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.100462 May 12 14:56:00.101549 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 473/965] 10.222.0.49 () {58 vars in 1154 bytes} [Thu May 12 14:55:59 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:56:00.191811 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-ec18c8db-1b7b-46a4-b08c-07505ccfdbb5 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:56:00.203988 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-ec18c8db-1b7b-46a4-b08c-07505ccfdbb5 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:56:00.205716 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-ec18c8db-1b7b-46a4-b08c-07505ccfdbb5 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:56:00.206909 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-ec18c8db-1b7b-46a4-b08c-07505ccfdbb5 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1" status: 200 len: 1730 microversion: 2.20 time: 0.245361 May 12 14:56:00.207466 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 493/966] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:55:59 2022] GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1 => generated 1730 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 14:56:01.225223 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-8a875016-f33a-473c-a600-93ce6d7b46c3 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:56:01.225838 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-8a875016-f33a-473c-a600-93ce6d7b46c3 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: 5184e752-c944-4ecd-a516-600944c18dc1] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:56:01.233747 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-8a875016-f33a-473c-a600-93ce6d7b46c3 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:01.234225 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-8a875016-f33a-473c-a600-93ce6d7b46c3 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:01.235056 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-8a875016-f33a-473c-a600-93ce6d7b46c3 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:01.236019 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-8a875016-f33a-473c-a600-93ce6d7b46c3 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:01.536412 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-8a875016-f33a-473c-a600-93ce6d7b46c3 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:56:01.546963 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-8a875016-f33a-473c-a600-93ce6d7b46c3 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:56:01.549745 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-8a875016-f33a-473c-a600-93ce6d7b46c3 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:56:01.551807 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-8a875016-f33a-473c-a600-93ce6d7b46c3 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1" status: 200 len: 1730 microversion: 2.20 time: 0.329869 May 12 14:56:01.564056 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 474/967] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:56:01 2022] GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1 => generated 1730 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:56:02.570253 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-60703ffc-584d-43be-a5ee-d8875fada4e7 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:56:02.570789 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-60703ffc-584d-43be-a5ee-d8875fada4e7 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: 5184e752-c944-4ecd-a516-600944c18dc1] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:56:02.578000 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-60703ffc-584d-43be-a5ee-d8875fada4e7 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:02.578448 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-60703ffc-584d-43be-a5ee-d8875fada4e7 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:02.579241 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-60703ffc-584d-43be-a5ee-d8875fada4e7 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:02.579675 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-60703ffc-584d-43be-a5ee-d8875fada4e7 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:02.781521 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-60703ffc-584d-43be-a5ee-d8875fada4e7 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:56:02.791022 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-60703ffc-584d-43be-a5ee-d8875fada4e7 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:56:02.792671 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-60703ffc-584d-43be-a5ee-d8875fada4e7 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:56:02.793797 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-60703ffc-584d-43be-a5ee-d8875fada4e7 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1" status: 200 len: 1730 microversion: 2.20 time: 0.227396 May 12 14:56:02.794346 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 494/968] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:56:02 2022] GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1 => generated 1730 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:56:03.819466 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-1c94b89c-d0c8-4de7-ae52-64c0985a108f tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:56:03.820901 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-1c94b89c-d0c8-4de7-ae52-64c0985a108f tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: 5184e752-c944-4ecd-a516-600944c18dc1] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:56:03.833540 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-1c94b89c-d0c8-4de7-ae52-64c0985a108f tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:03.834210 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-1c94b89c-d0c8-4de7-ae52-64c0985a108f tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:03.835253 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-1c94b89c-d0c8-4de7-ae52-64c0985a108f tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:03.835888 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-1c94b89c-d0c8-4de7-ae52-64c0985a108f tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:04.073537 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-1c94b89c-d0c8-4de7-ae52-64c0985a108f tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:56:04.090909 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-1c94b89c-d0c8-4de7-ae52-64c0985a108f tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:56:04.112358 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-1c94b89c-d0c8-4de7-ae52-64c0985a108f tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:56:04.112358 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-1c94b89c-d0c8-4de7-ae52-64c0985a108f tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1" status: 200 len: 1730 microversion: 2.20 time: 0.286494 May 12 14:56:04.112358 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 475/969] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:56:03 2022] GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1 => generated 1730 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:56:05.118784 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-4c57a8fc-5aae-41fe-95f6-95481dcf007e tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:56:05.119365 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-4c57a8fc-5aae-41fe-95f6-95481dcf007e tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: 5184e752-c944-4ecd-a516-600944c18dc1] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:56:05.127865 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-4c57a8fc-5aae-41fe-95f6-95481dcf007e tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:05.128435 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-4c57a8fc-5aae-41fe-95f6-95481dcf007e tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:05.129666 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-4c57a8fc-5aae-41fe-95f6-95481dcf007e tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:05.130396 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-4c57a8fc-5aae-41fe-95f6-95481dcf007e tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:05.383499 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-4c57a8fc-5aae-41fe-95f6-95481dcf007e tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:56:05.396814 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-4c57a8fc-5aae-41fe-95f6-95481dcf007e tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:56:05.398560 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-4c57a8fc-5aae-41fe-95f6-95481dcf007e tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:56:05.404306 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-4c57a8fc-5aae-41fe-95f6-95481dcf007e tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1" status: 200 len: 1730 microversion: 2.20 time: 0.289163 May 12 14:56:05.405063 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 495/970] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:56:05 2022] GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1 => generated 1730 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:56:06.427201 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-98733075-98c6-4524-aab5-630f080acba0 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:56:06.427970 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-98733075-98c6-4524-aab5-630f080acba0 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: 5184e752-c944-4ecd-a516-600944c18dc1] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:56:06.436399 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-98733075-98c6-4524-aab5-630f080acba0 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:06.436870 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-98733075-98c6-4524-aab5-630f080acba0 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:06.437664 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-98733075-98c6-4524-aab5-630f080acba0 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:06.438106 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-98733075-98c6-4524-aab5-630f080acba0 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:06.692786 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-98733075-98c6-4524-aab5-630f080acba0 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:56:06.702426 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-98733075-98c6-4524-aab5-630f080acba0 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:56:06.704487 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-98733075-98c6-4524-aab5-630f080acba0 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:56:06.705619 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-98733075-98c6-4524-aab5-630f080acba0 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1" status: 200 len: 1730 microversion: 2.20 time: 0.282760 May 12 14:56:06.708154 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 476/971] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:56:06 2022] GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1 => generated 1730 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:56:07.725708 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-e775f6a0-f601-4661-bec6-69b00d1312c7 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:56:07.727039 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-e775f6a0-f601-4661-bec6-69b00d1312c7 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: 5184e752-c944-4ecd-a516-600944c18dc1] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:56:07.739404 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e775f6a0-f601-4661-bec6-69b00d1312c7 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:07.742509 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e775f6a0-f601-4661-bec6-69b00d1312c7 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:07.748845 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e775f6a0-f601-4661-bec6-69b00d1312c7 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:07.749266 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e775f6a0-f601-4661-bec6-69b00d1312c7 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:08.431726 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-e775f6a0-f601-4661-bec6-69b00d1312c7 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:56:08.457168 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-e775f6a0-f601-4661-bec6-69b00d1312c7 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:56:08.459555 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-e775f6a0-f601-4661-bec6-69b00d1312c7 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:56:08.462100 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-e775f6a0-f601-4661-bec6-69b00d1312c7 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1" status: 200 len: 1730 microversion: 2.20 time: 0.739690 May 12 14:56:08.463456 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 496/972] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:56:07 2022] GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1 => generated 1730 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:56:09.482487 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-a2c67d35-50a3-49ae-9e60-7048aef6a34d tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:56:09.483780 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-a2c67d35-50a3-49ae-9e60-7048aef6a34d tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: 5184e752-c944-4ecd-a516-600944c18dc1] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:56:09.495567 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-a2c67d35-50a3-49ae-9e60-7048aef6a34d tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:09.496019 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-a2c67d35-50a3-49ae-9e60-7048aef6a34d tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:09.500258 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-a2c67d35-50a3-49ae-9e60-7048aef6a34d tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:09.501059 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-a2c67d35-50a3-49ae-9e60-7048aef6a34d tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:10.216907 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-a2c67d35-50a3-49ae-9e60-7048aef6a34d tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:56:10.229876 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-a2c67d35-50a3-49ae-9e60-7048aef6a34d tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:56:10.231963 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-a2c67d35-50a3-49ae-9e60-7048aef6a34d tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:56:10.241986 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-a2c67d35-50a3-49ae-9e60-7048aef6a34d tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1" status: 200 len: 1730 microversion: 2.20 time: 0.764259 May 12 14:56:10.243222 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 477/973] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:56:09 2022] GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1 => generated 1730 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:56:10.670653 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [req-daae1106-3d39-4727-8e82-992a48b44b15 req-6d7a85ef-52e6-46ff-bd0c-fe8676f278d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7855c920-9df4-495a-9733-78fe42b1705d", "tag": "71d6ba38-f010-4812-ade3-cd0173c05466"}]} {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:56:10.670653 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:56:10.670653 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: warnings.warn(msg) May 12 14:56:10.670653 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [req-daae1106-3d39-4727-8e82-992a48b44b15 req-6d7a85ef-52e6-46ff-bd0c-fe8676f278d4 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:10.670653 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [req-daae1106-3d39-4727-8e82-992a48b44b15 req-6d7a85ef-52e6-46ff-bd0c-fe8676f278d4 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:10.680421 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-aef6c2fb-4d1f-4062-b920-e97e1b4e5116 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:56:10.683074 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-aef6c2fb-4d1f-4062-b920-e97e1b4e5116 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] [instance: 7855c920-9df4-495a-9733-78fe42b1705d] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:56:10.694017 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.compute.server_external_events [req-daae1106-3d39-4727-8e82-992a48b44b15 req-6d7a85ef-52e6-46ff-bd0c-fe8676f278d4 service nova] Creating event network-changed:71d6ba38-f010-4812-ade3-cd0173c05466 for instance 7855c920-9df4-495a-9733-78fe42b1705d on hv-cinder-83118 May 12 14:56:10.701551 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-aef6c2fb-4d1f-4062-b920-e97e1b4e5116 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:10.703586 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-aef6c2fb-4d1f-4062-b920-e97e1b4e5116 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:10.704110 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [req-daae1106-3d39-4727-8e82-992a48b44b15 req-6d7a85ef-52e6-46ff-bd0c-fe8676f278d4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050536 May 12 14:56:10.705896 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 497/974] 10.222.0.49 () {64 vars in 1317 bytes} [Thu May 12 14:56:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:56:10.706180 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-aef6c2fb-4d1f-4062-b920-e97e1b4e5116 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:10.706830 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-aef6c2fb-4d1f-4062-b920-e97e1b4e5116 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:10.834248 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-aef6c2fb-4d1f-4062-b920-e97e1b4e5116 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] [instance: 7855c920-9df4-495a-9733-78fe42b1705d] Going to try to terminate instance {{(pid=102212) delete /opt/stack/nova/nova/compute/api.py:2562}} May 12 14:56:11.262029 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-c40e738e-8a63-460a-9c7f-61c65fd5924a tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:56:11.263120 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-c40e738e-8a63-460a-9c7f-61c65fd5924a tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: 5184e752-c944-4ecd-a516-600944c18dc1] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:56:11.279070 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-c40e738e-8a63-460a-9c7f-61c65fd5924a tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:11.279762 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-c40e738e-8a63-460a-9c7f-61c65fd5924a tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:11.281182 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-c40e738e-8a63-460a-9c7f-61c65fd5924a tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:11.281862 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-c40e738e-8a63-460a-9c7f-61c65fd5924a tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:11.512421 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-c40e738e-8a63-460a-9c7f-61c65fd5924a tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:56:11.521435 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-c40e738e-8a63-460a-9c7f-61c65fd5924a tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:56:11.523204 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-c40e738e-8a63-460a-9c7f-61c65fd5924a tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:56:11.524252 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-c40e738e-8a63-460a-9c7f-61c65fd5924a tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1" status: 200 len: 1730 microversion: 2.20 time: 0.266404 May 12 14:56:11.524826 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 498/975] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:56:11 2022] GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1 => generated 1730 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 14:56:12.485189 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-aef6c2fb-4d1f-4062-b920-e97e1b4e5116 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] 10.222.0.49 "DELETE /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d" status: 204 len: 0 microversion: 2.1 time: 1.806348 May 12 14:56:12.485189 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 478/976] 10.222.0.49 () {58 vars in 1238 bytes} [Thu May 12 14:56:10 2022] DELETE /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d => generated 0 bytes in 1808 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 14:56:12.494394 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-b0684003-6ee9-4832-ae96-9753fd1ca55f tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:56:12.495264 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-b0684003-6ee9-4832-ae96-9753fd1ca55f tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] [instance: 7855c920-9df4-495a-9733-78fe42b1705d] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:56:12.503106 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-b0684003-6ee9-4832-ae96-9753fd1ca55f tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:12.503941 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-b0684003-6ee9-4832-ae96-9753fd1ca55f tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:12.504894 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-b0684003-6ee9-4832-ae96-9753fd1ca55f tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:12.505540 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-b0684003-6ee9-4832-ae96-9753fd1ca55f tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:12.545426 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-0b6205b8-d7c1-4b3e-9755-eff2d3fdb3ab tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:56:12.546139 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-0b6205b8-d7c1-4b3e-9755-eff2d3fdb3ab tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: 5184e752-c944-4ecd-a516-600944c18dc1] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:56:12.555844 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-0b6205b8-d7c1-4b3e-9755-eff2d3fdb3ab tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:12.557078 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-0b6205b8-d7c1-4b3e-9755-eff2d3fdb3ab tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:12.558185 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-0b6205b8-d7c1-4b3e-9755-eff2d3fdb3ab tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:12.559558 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-0b6205b8-d7c1-4b3e-9755-eff2d3fdb3ab tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:12.814338 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-b0684003-6ee9-4832-ae96-9753fd1ca55f tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6d3863350647cdb3091c1006d56c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfe8d8bce3f496d9162c7f9c8727273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:56:12.824797 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-b0684003-6ee9-4832-ae96-9753fd1ca55f tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] 10.222.0.49 "GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d" status: 200 len: 1567 microversion: 2.1 time: 0.337632 May 12 14:56:12.837881 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 499/977] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:56:12 2022] GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d => generated 1567 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:56:12.913606 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-0b6205b8-d7c1-4b3e-9755-eff2d3fdb3ab tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:56:12.923365 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-0b6205b8-d7c1-4b3e-9755-eff2d3fdb3ab tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:56:12.924972 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-0b6205b8-d7c1-4b3e-9755-eff2d3fdb3ab tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:56:12.926328 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-0b6205b8-d7c1-4b3e-9755-eff2d3fdb3ab tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1" status: 200 len: 1730 microversion: 2.20 time: 0.386353 May 12 14:56:12.927232 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 479/978] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:56:12 2022] GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1 => generated 1730 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:56:13.854126 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-0d8c03e8-ab9e-4849-9d9e-8506c563279e tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:56:13.855297 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-0d8c03e8-ab9e-4849-9d9e-8506c563279e tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] [instance: 7855c920-9df4-495a-9733-78fe42b1705d] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:56:13.869577 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-0d8c03e8-ab9e-4849-9d9e-8506c563279e tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:13.871306 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-0d8c03e8-ab9e-4849-9d9e-8506c563279e tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:13.873252 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-0d8c03e8-ab9e-4849-9d9e-8506c563279e tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:13.874118 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-0d8c03e8-ab9e-4849-9d9e-8506c563279e tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:13.943974 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-a6b0f0f1-36a5-43cc-9d96-02c5807f0d31 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:56:13.944623 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-a6b0f0f1-36a5-43cc-9d96-02c5807f0d31 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: 5184e752-c944-4ecd-a516-600944c18dc1] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:56:13.951875 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-a6b0f0f1-36a5-43cc-9d96-02c5807f0d31 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:13.952312 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-a6b0f0f1-36a5-43cc-9d96-02c5807f0d31 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:13.953073 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-a6b0f0f1-36a5-43cc-9d96-02c5807f0d31 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:13.953572 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-a6b0f0f1-36a5-43cc-9d96-02c5807f0d31 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:14.105097 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-0d8c03e8-ab9e-4849-9d9e-8506c563279e tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6d3863350647cdb3091c1006d56c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfe8d8bce3f496d9162c7f9c8727273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:56:14.125045 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-0d8c03e8-ab9e-4849-9d9e-8506c563279e tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] 10.222.0.49 "GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d" status: 200 len: 1449 microversion: 2.1 time: 0.281759 May 12 14:56:14.135292 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 500/979] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:56:13 2022] GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d => generated 1449 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:56:14.175297 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-a6b0f0f1-36a5-43cc-9d96-02c5807f0d31 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:56:14.187132 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-a6b0f0f1-36a5-43cc-9d96-02c5807f0d31 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:56:14.190145 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-a6b0f0f1-36a5-43cc-9d96-02c5807f0d31 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:56:14.191688 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-a6b0f0f1-36a5-43cc-9d96-02c5807f0d31 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1" status: 200 len: 1730 microversion: 2.20 time: 0.251309 May 12 14:56:14.203130 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 480/980] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:56:13 2022] GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1 => generated 1730 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:56:15.142648 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-7e9cfbc5-4a39-4637-a024-5058368b0666 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:56:15.155152 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-7e9cfbc5-4a39-4637-a024-5058368b0666 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] [instance: 7855c920-9df4-495a-9733-78fe42b1705d] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:56:15.155152 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-7e9cfbc5-4a39-4637-a024-5058368b0666 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:15.155152 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-7e9cfbc5-4a39-4637-a024-5058368b0666 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:15.155152 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-7e9cfbc5-4a39-4637-a024-5058368b0666 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:15.155555 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-7e9cfbc5-4a39-4637-a024-5058368b0666 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:15.212355 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-9c8d7189-1712-40db-8678-227ad12f2101 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:56:15.213125 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-9c8d7189-1712-40db-8678-227ad12f2101 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: 5184e752-c944-4ecd-a516-600944c18dc1] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:56:15.232556 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-9c8d7189-1712-40db-8678-227ad12f2101 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:15.252375 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-9c8d7189-1712-40db-8678-227ad12f2101 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:15.252375 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-9c8d7189-1712-40db-8678-227ad12f2101 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:15.252375 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-9c8d7189-1712-40db-8678-227ad12f2101 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:15.373647 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-7e9cfbc5-4a39-4637-a024-5058368b0666 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6d3863350647cdb3091c1006d56c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfe8d8bce3f496d9162c7f9c8727273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:56:15.383020 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-7e9cfbc5-4a39-4637-a024-5058368b0666 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] 10.222.0.49 "GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d" status: 200 len: 1449 microversion: 2.1 time: 0.244585 May 12 14:56:15.383522 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 501/981] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:56:15 2022] GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d => generated 1449 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:56:15.459637 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-9c8d7189-1712-40db-8678-227ad12f2101 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:56:15.468373 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-9c8d7189-1712-40db-8678-227ad12f2101 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:56:15.469947 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-9c8d7189-1712-40db-8678-227ad12f2101 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:56:15.471157 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-9c8d7189-1712-40db-8678-227ad12f2101 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1" status: 200 len: 1730 microversion: 2.20 time: 0.263249 May 12 14:56:15.472056 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 481/982] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:56:15 2022] GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1 => generated 1730 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:56:15.636222 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [req-09673aa8-32ec-4a49-a5c0-311049eaf030 req-3906619b-c36c-49b9-931f-68521391e827 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7855c920-9df4-495a-9733-78fe42b1705d", "name": "network-vif-deleted", "tag": "71d6ba38-f010-4812-ade3-cd0173c05466"}]} {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:56:15.636222 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:56:15.636222 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: warnings.warn(msg) May 12 14:56:15.636222 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [req-09673aa8-32ec-4a49-a5c0-311049eaf030 req-3906619b-c36c-49b9-931f-68521391e827 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:15.636222 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [req-09673aa8-32ec-4a49-a5c0-311049eaf030 req-3906619b-c36c-49b9-931f-68521391e827 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:15.649004 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.compute.server_external_events [req-09673aa8-32ec-4a49-a5c0-311049eaf030 req-3906619b-c36c-49b9-931f-68521391e827 service nova] Creating event network-vif-deleted:71d6ba38-f010-4812-ade3-cd0173c05466 for instance 7855c920-9df4-495a-9733-78fe42b1705d on hv-cinder-83118 May 12 14:56:15.653811 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [req-09673aa8-32ec-4a49-a5c0-311049eaf030 req-3906619b-c36c-49b9-931f-68521391e827 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034600 May 12 14:56:15.654416 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 502/983] 10.222.0.49 () {64 vars in 1317 bytes} [Thu May 12 14:56:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 14:56:16.400780 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-9ace700c-d614-4e12-8063-bacb7f0702ff tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:56:16.401614 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-9ace700c-d614-4e12-8063-bacb7f0702ff tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] [instance: 7855c920-9df4-495a-9733-78fe42b1705d] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:56:16.409509 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-9ace700c-d614-4e12-8063-bacb7f0702ff tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:16.410349 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-9ace700c-d614-4e12-8063-bacb7f0702ff tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:16.411373 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-9ace700c-d614-4e12-8063-bacb7f0702ff tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:16.411881 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-9ace700c-d614-4e12-8063-bacb7f0702ff tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:16.494615 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-59d9a0cb-a712-474e-997c-bd3d057845e8 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:56:16.494615 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-59d9a0cb-a712-474e-997c-bd3d057845e8 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: 5184e752-c944-4ecd-a516-600944c18dc1] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:56:16.502016 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-59d9a0cb-a712-474e-997c-bd3d057845e8 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:16.503701 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-59d9a0cb-a712-474e-997c-bd3d057845e8 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:16.504817 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-59d9a0cb-a712-474e-997c-bd3d057845e8 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:16.505400 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-59d9a0cb-a712-474e-997c-bd3d057845e8 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:16.729499 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-9ace700c-d614-4e12-8063-bacb7f0702ff tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6d3863350647cdb3091c1006d56c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfe8d8bce3f496d9162c7f9c8727273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:56:16.740613 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-9ace700c-d614-4e12-8063-bacb7f0702ff tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] 10.222.0.49 "GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d" status: 200 len: 1219 microversion: 2.1 time: 0.344261 May 12 14:56:16.741519 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 482/984] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:56:16 2022] GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d => generated 1219 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:56:16.918129 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-59d9a0cb-a712-474e-997c-bd3d057845e8 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:56:16.927125 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-59d9a0cb-a712-474e-997c-bd3d057845e8 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:56:16.928789 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-59d9a0cb-a712-474e-997c-bd3d057845e8 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:56:16.929922 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-59d9a0cb-a712-474e-997c-bd3d057845e8 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1" status: 200 len: 1730 microversion: 2.20 time: 0.443559 May 12 14:56:16.930479 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 503/985] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:56:16 2022] GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1 => generated 1730 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 14:56:17.758571 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-f5382123-da0a-4f11-8691-99d3450a4a02 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:56:17.759547 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-f5382123-da0a-4f11-8691-99d3450a4a02 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] [instance: 7855c920-9df4-495a-9733-78fe42b1705d] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:56:17.767077 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-f5382123-da0a-4f11-8691-99d3450a4a02 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:17.767566 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-f5382123-da0a-4f11-8691-99d3450a4a02 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:17.768345 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-f5382123-da0a-4f11-8691-99d3450a4a02 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:17.768786 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-f5382123-da0a-4f11-8691-99d3450a4a02 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:17.844857 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-f5382123-da0a-4f11-8691-99d3450a4a02 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:17.845310 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-f5382123-da0a-4f11-8691-99d3450a4a02 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:17.845776 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.objects.instance [None req-f5382123-da0a-4f11-8691-99d3450a4a02 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lazy-loading 'fault' on Instance uuid 7855c920-9df4-495a-9733-78fe42b1705d {{(pid=102212) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 12 14:56:17.924462 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-f5382123-da0a-4f11-8691-99d3450a4a02 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be6d3863350647cdb3091c1006d56c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bfe8d8bce3f496d9162c7f9c8727273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:56:17.932927 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-f5382123-da0a-4f11-8691-99d3450a4a02 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] 10.222.0.49 "GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d" status: 200 len: 1224 microversion: 2.1 time: 0.178791 May 12 14:56:17.933501 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 483/986] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:56:17 2022] GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d => generated 1224 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:56:17.948615 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-8411d508-527e-4b2f-85ed-776c165238d5 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:56:17.949260 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-8411d508-527e-4b2f-85ed-776c165238d5 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: 5184e752-c944-4ecd-a516-600944c18dc1] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:56:17.956894 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-8411d508-527e-4b2f-85ed-776c165238d5 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:17.957536 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-8411d508-527e-4b2f-85ed-776c165238d5 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:17.959416 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-8411d508-527e-4b2f-85ed-776c165238d5 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:17.959994 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-8411d508-527e-4b2f-85ed-776c165238d5 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:18.069145 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [req-bf35d145-e10b-49cf-b667-a9c1a7bfa181 req-55efc948-294d-4ed9-a903-67be850a57c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5184e752-c944-4ecd-a516-600944c18dc1", "name": "network-vif-plugged", "status": "completed", "tag": "74c60ae0-11dc-4a5e-afb9-11e124615006"}]} {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:56:18.070669 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:56:18.070669 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: warnings.warn(msg) May 12 14:56:18.081715 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [req-bf35d145-e10b-49cf-b667-a9c1a7bfa181 req-55efc948-294d-4ed9-a903-67be850a57c2 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:18.084586 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [req-bf35d145-e10b-49cf-b667-a9c1a7bfa181 req-55efc948-294d-4ed9-a903-67be850a57c2 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:18.112200 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.compute.server_external_events [req-bf35d145-e10b-49cf-b667-a9c1a7bfa181 req-55efc948-294d-4ed9-a903-67be850a57c2 service nova] Creating event network-vif-plugged:74c60ae0-11dc-4a5e-afb9-11e124615006 for instance 5184e752-c944-4ecd-a516-600944c18dc1 on hv-cinder-83118 May 12 14:56:18.118047 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [req-bf35d145-e10b-49cf-b667-a9c1a7bfa181 req-55efc948-294d-4ed9-a903-67be850a57c2 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052763 May 12 14:56:18.119114 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 484/987] 10.222.0.49 () {64 vars in 1317 bytes} [Thu May 12 14:56:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 14:56:18.251841 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-8411d508-527e-4b2f-85ed-776c165238d5 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:56:18.262737 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-8411d508-527e-4b2f-85ed-776c165238d5 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:56:18.274608 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-8411d508-527e-4b2f-85ed-776c165238d5 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:56:18.274608 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-8411d508-527e-4b2f-85ed-776c165238d5 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1" status: 200 len: 1730 microversion: 2.20 time: 0.327090 May 12 14:56:18.274608 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 504/988] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:56:17 2022] GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1 => generated 1730 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:56:18.955279 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-142973bc-cd2d-481a-8f43-c021466b546c tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:56:18.955972 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-142973bc-cd2d-481a-8f43-c021466b546c tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] [instance: 7855c920-9df4-495a-9733-78fe42b1705d] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:56:18.966946 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-142973bc-cd2d-481a-8f43-c021466b546c tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:18.966946 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-142973bc-cd2d-481a-8f43-c021466b546c tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:18.966946 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-142973bc-cd2d-481a-8f43-c021466b546c tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:18.966946 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-142973bc-cd2d-481a-8f43-c021466b546c tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:19.014753 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.wsgi [None req-142973bc-cd2d-481a-8f43-c021466b546c tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] HTTP exception thrown: Instance 7855c920-9df4-495a-9733-78fe42b1705d could not be found. May 12 14:56:19.015380 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-142973bc-cd2d-481a-8f43-c021466b546c tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Returning 404 to user: Instance 7855c920-9df4-495a-9733-78fe42b1705d could not be found. {{(pid=102212) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 12 14:56:19.016213 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-142973bc-cd2d-481a-8f43-c021466b546c tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] 10.222.0.49 "GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d" status: 404 len: 111 microversion: 2.1 time: 0.065235 May 12 14:56:19.016760 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 485/989] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:56:18 2022] GET /compute/v2.1/servers/7855c920-9df4-495a-9733-78fe42b1705d => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 14:56:19.289687 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-54299398-7a8d-4809-bb5c-857f6fcfd50a tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:56:19.290476 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-54299398-7a8d-4809-bb5c-857f6fcfd50a tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: 5184e752-c944-4ecd-a516-600944c18dc1] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:56:19.298781 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-54299398-7a8d-4809-bb5c-857f6fcfd50a tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:19.299414 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-54299398-7a8d-4809-bb5c-857f6fcfd50a tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:19.300338 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-54299398-7a8d-4809-bb5c-857f6fcfd50a tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:19.301159 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-54299398-7a8d-4809-bb5c-857f6fcfd50a tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:19.491952 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-79a40376-20f5-4220-a993-144bdcb86eb0 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] Calling method '.version_select at 0x7ff77e5499d0>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:56:19.512214 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-54299398-7a8d-4809-bb5c-857f6fcfd50a tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:56:19.521317 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-54299398-7a8d-4809-bb5c-857f6fcfd50a tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:56:19.522789 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-54299398-7a8d-4809-bb5c-857f6fcfd50a tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:56:19.523925 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-54299398-7a8d-4809-bb5c-857f6fcfd50a tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1" status: 200 len: 1730 microversion: 2.20 time: 0.238138 May 12 14:56:19.524467 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 505/990] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:56:19 2022] GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1 => generated 1730 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:56:19.684008 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-79a40376-20f5-4220-a993-144bdcb86eb0 tempest-TestShelveInstance-646637314 tempest-TestShelveInstance-646637314-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1024472412" status: 202 len: 0 microversion: 2.1 time: 0.195757 May 12 14:56:19.684521 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 486/991] 10.222.0.49 () {58 vars in 1253 bytes} [Thu May 12 14:56:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1024472412 => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 12 14:56:20.541579 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-0ca77cfb-8ae4-4e8b-8540-02cc94ccecda tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:56:20.542160 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-0ca77cfb-8ae4-4e8b-8540-02cc94ccecda tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: 5184e752-c944-4ecd-a516-600944c18dc1] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:56:20.569585 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-0ca77cfb-8ae4-4e8b-8540-02cc94ccecda tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:20.570363 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-0ca77cfb-8ae4-4e8b-8540-02cc94ccecda tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:20.571379 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-0ca77cfb-8ae4-4e8b-8540-02cc94ccecda tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:20.571967 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-0ca77cfb-8ae4-4e8b-8540-02cc94ccecda tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:20.994244 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-0ca77cfb-8ae4-4e8b-8540-02cc94ccecda tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:56:21.007613 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-0ca77cfb-8ae4-4e8b-8540-02cc94ccecda tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:56:21.009901 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-0ca77cfb-8ae4-4e8b-8540-02cc94ccecda tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:56:21.012270 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-0ca77cfb-8ae4-4e8b-8540-02cc94ccecda tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1" status: 200 len: 1730 microversion: 2.20 time: 0.474217 May 12 14:56:21.013343 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 506/992] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:56:20 2022] GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1 => generated 1730 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:56:21.232358 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-f0847ff3-40e4-4003-8662-1df1afab4118 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:56:21.233543 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-f0847ff3-40e4-4003-8662-1df1afab4118 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] [instance: 12704ca3-a417-4cab-9a2c-98b9275218eb] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:56:21.242330 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-f0847ff3-40e4-4003-8662-1df1afab4118 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:21.242894 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-f0847ff3-40e4-4003-8662-1df1afab4118 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:21.243883 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-f0847ff3-40e4-4003-8662-1df1afab4118 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:21.244363 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-f0847ff3-40e4-4003-8662-1df1afab4118 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:21.318314 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-f0847ff3-40e4-4003-8662-1df1afab4118 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] [instance: 12704ca3-a417-4cab-9a2c-98b9275218eb] Going to try to terminate instance {{(pid=102212) delete /opt/stack/nova/nova/compute/api.py:2562}} May 12 14:56:21.786888 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-f0847ff3-40e4-4003-8662-1df1afab4118 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] 10.222.0.49 "DELETE /compute/v2.1/servers/12704ca3-a417-4cab-9a2c-98b9275218eb" status: 204 len: 0 microversion: 2.1 time: 0.558134 May 12 14:56:21.789553 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 487/993] 10.222.0.49 () {58 vars in 1238 bytes} [Thu May 12 14:56:21 2022] DELETE /compute/v2.1/servers/12704ca3-a417-4cab-9a2c-98b9275218eb => generated 0 bytes in 562 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 14:56:21.798057 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-f5a4f1df-45a5-4d4b-808d-aeadee1b4908 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:56:21.799283 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-f5a4f1df-45a5-4d4b-808d-aeadee1b4908 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] [instance: 12704ca3-a417-4cab-9a2c-98b9275218eb] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:56:21.814175 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-f5a4f1df-45a5-4d4b-808d-aeadee1b4908 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:21.815064 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-f5a4f1df-45a5-4d4b-808d-aeadee1b4908 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:21.816037 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-f5a4f1df-45a5-4d4b-808d-aeadee1b4908 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:21.816633 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-f5a4f1df-45a5-4d4b-808d-aeadee1b4908 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:22.034119 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-c7a4778c-99d6-4bf4-a4c4-dc480cf46920 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:56:22.034843 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-c7a4778c-99d6-4bf4-a4c4-dc480cf46920 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: 5184e752-c944-4ecd-a516-600944c18dc1] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:56:22.042355 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-c7a4778c-99d6-4bf4-a4c4-dc480cf46920 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:22.042804 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-c7a4778c-99d6-4bf4-a4c4-dc480cf46920 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:22.043639 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-c7a4778c-99d6-4bf4-a4c4-dc480cf46920 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:22.044054 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-c7a4778c-99d6-4bf4-a4c4-dc480cf46920 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:22.258988 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-c7a4778c-99d6-4bf4-a4c4-dc480cf46920 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:56:22.268695 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-c7a4778c-99d6-4bf4-a4c4-dc480cf46920 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:56:22.270222 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-c7a4778c-99d6-4bf4-a4c4-dc480cf46920 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:56:22.271380 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-c7a4778c-99d6-4bf4-a4c4-dc480cf46920 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1" status: 200 len: 1717 microversion: 2.20 time: 0.242113 May 12 14:56:22.271932 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 488/994] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:56:22 2022] GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1 => generated 1717 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 12 14:56:22.319815 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-f5a4f1df-45a5-4d4b-808d-aeadee1b4908 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef8036bc3ad4725b3af2607ceb17c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235689d103ed4d0dbe7b78698395bd21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:56:22.328021 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-f5a4f1df-45a5-4d4b-808d-aeadee1b4908 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] 10.222.0.49 "GET /compute/v2.1/servers/12704ca3-a417-4cab-9a2c-98b9275218eb" status: 200 len: 1580 microversion: 2.1 time: 0.533746 May 12 14:56:22.328695 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 507/995] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:56:21 2022] GET /compute/v2.1/servers/12704ca3-a417-4cab-9a2c-98b9275218eb => generated 1580 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:56:23.349164 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-521d1783-c6dd-40b7-b3bd-fe8c72ca07a8 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:56:23.351226 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-521d1783-c6dd-40b7-b3bd-fe8c72ca07a8 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] [instance: 12704ca3-a417-4cab-9a2c-98b9275218eb] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:56:23.362399 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-521d1783-c6dd-40b7-b3bd-fe8c72ca07a8 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:23.363781 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-521d1783-c6dd-40b7-b3bd-fe8c72ca07a8 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:23.364909 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-521d1783-c6dd-40b7-b3bd-fe8c72ca07a8 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:23.365513 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-521d1783-c6dd-40b7-b3bd-fe8c72ca07a8 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:23.722205 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-521d1783-c6dd-40b7-b3bd-fe8c72ca07a8 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef8036bc3ad4725b3af2607ceb17c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235689d103ed4d0dbe7b78698395bd21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:56:23.735470 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-521d1783-c6dd-40b7-b3bd-fe8c72ca07a8 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] 10.222.0.49 "GET /compute/v2.1/servers/12704ca3-a417-4cab-9a2c-98b9275218eb" status: 200 len: 1580 microversion: 2.1 time: 0.391379 May 12 14:56:23.736312 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 489/996] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:56:23 2022] GET /compute/v2.1/servers/12704ca3-a417-4cab-9a2c-98b9275218eb => generated 1580 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:56:24.753258 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-3ac89172-7c43-46ef-b5ed-dc8141f2a382 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:56:24.754006 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-3ac89172-7c43-46ef-b5ed-dc8141f2a382 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] [instance: 12704ca3-a417-4cab-9a2c-98b9275218eb] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:56:24.761693 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-3ac89172-7c43-46ef-b5ed-dc8141f2a382 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:24.762252 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-3ac89172-7c43-46ef-b5ed-dc8141f2a382 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:24.763505 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-3ac89172-7c43-46ef-b5ed-dc8141f2a382 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:24.764106 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-3ac89172-7c43-46ef-b5ed-dc8141f2a382 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:25.355458 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-3ac89172-7c43-46ef-b5ed-dc8141f2a382 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef8036bc3ad4725b3af2607ceb17c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235689d103ed4d0dbe7b78698395bd21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:56:25.364940 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-3ac89172-7c43-46ef-b5ed-dc8141f2a382 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] 10.222.0.49 "GET /compute/v2.1/servers/12704ca3-a417-4cab-9a2c-98b9275218eb" status: 200 len: 1580 microversion: 2.1 time: 0.615755 May 12 14:56:25.365946 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 508/997] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:56:24 2022] GET /compute/v2.1/servers/12704ca3-a417-4cab-9a2c-98b9275218eb => generated 1580 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:56:26.383424 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-8c66ff5a-44e3-492d-a0a3-05f82a9b5e96 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:56:26.389536 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-8c66ff5a-44e3-492d-a0a3-05f82a9b5e96 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] [instance: 12704ca3-a417-4cab-9a2c-98b9275218eb] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:56:26.396765 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [req-363a3dc6-5286-4a30-8b48-714658012c3f req-e9a5c012-7bd5-42ef-83b1-612793f4e0e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12704ca3-a417-4cab-9a2c-98b9275218eb", "name": "network-vif-deleted", "tag": "b2d377be-5a49-46c3-8536-f69f3d36a7e9"}]} {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:56:26.398515 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:56:26.398515 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: warnings.warn(msg) May 12 14:56:26.413484 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-8c66ff5a-44e3-492d-a0a3-05f82a9b5e96 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:26.417213 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [req-363a3dc6-5286-4a30-8b48-714658012c3f req-e9a5c012-7bd5-42ef-83b1-612793f4e0e3 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:26.417659 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [req-363a3dc6-5286-4a30-8b48-714658012c3f req-e9a5c012-7bd5-42ef-83b1-612793f4e0e3 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:26.427191 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-8c66ff5a-44e3-492d-a0a3-05f82a9b5e96 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:26.428260 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-8c66ff5a-44e3-492d-a0a3-05f82a9b5e96 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:26.428858 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-8c66ff5a-44e3-492d-a0a3-05f82a9b5e96 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:26.453485 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.compute.server_external_events [req-363a3dc6-5286-4a30-8b48-714658012c3f req-e9a5c012-7bd5-42ef-83b1-612793f4e0e3 service nova] Creating event network-vif-deleted:b2d377be-5a49-46c3-8536-f69f3d36a7e9 for instance 12704ca3-a417-4cab-9a2c-98b9275218eb on hv-cinder-83118 May 12 14:56:26.465907 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [req-363a3dc6-5286-4a30-8b48-714658012c3f req-e9a5c012-7bd5-42ef-83b1-612793f4e0e3 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076331 May 12 14:56:26.466521 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 509/998] 10.222.0.49 () {64 vars in 1317 bytes} [Thu May 12 14:56:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:56:26.584552 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-8c66ff5a-44e3-492d-a0a3-05f82a9b5e96 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef8036bc3ad4725b3af2607ceb17c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235689d103ed4d0dbe7b78698395bd21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:56:26.593788 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-8c66ff5a-44e3-492d-a0a3-05f82a9b5e96 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] 10.222.0.49 "GET /compute/v2.1/servers/12704ca3-a417-4cab-9a2c-98b9275218eb" status: 200 len: 1512 microversion: 2.1 time: 0.214657 May 12 14:56:26.594689 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 490/999] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:56:26 2022] GET /compute/v2.1/servers/12704ca3-a417-4cab-9a2c-98b9275218eb => generated 1512 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:56:27.617953 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-e51b6a75-f565-44f1-a2ea-b4ed8b87eab7 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:56:27.620054 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-e51b6a75-f565-44f1-a2ea-b4ed8b87eab7 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] [instance: 12704ca3-a417-4cab-9a2c-98b9275218eb] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:56:27.635193 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e51b6a75-f565-44f1-a2ea-b4ed8b87eab7 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:27.636157 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e51b6a75-f565-44f1-a2ea-b4ed8b87eab7 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:27.637658 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e51b6a75-f565-44f1-a2ea-b4ed8b87eab7 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:27.638574 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e51b6a75-f565-44f1-a2ea-b4ed8b87eab7 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:27.754665 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e51b6a75-f565-44f1-a2ea-b4ed8b87eab7 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:27.755768 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e51b6a75-f565-44f1-a2ea-b4ed8b87eab7 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:27.756471 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.objects.instance [None req-e51b6a75-f565-44f1-a2ea-b4ed8b87eab7 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lazy-loading 'fault' on Instance uuid 12704ca3-a417-4cab-9a2c-98b9275218eb {{(pid=102213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 12 14:56:27.937296 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-e51b6a75-f565-44f1-a2ea-b4ed8b87eab7 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef8036bc3ad4725b3af2607ceb17c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235689d103ed4d0dbe7b78698395bd21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:56:27.945861 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-e51b6a75-f565-44f1-a2ea-b4ed8b87eab7 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] 10.222.0.49 "GET /compute/v2.1/servers/12704ca3-a417-4cab-9a2c-98b9275218eb" status: 200 len: 1231 microversion: 2.1 time: 0.335707 May 12 14:56:27.946572 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 510/1000] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:56:27 2022] GET /compute/v2.1/servers/12704ca3-a417-4cab-9a2c-98b9275218eb => generated 1231 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:56:28.963224 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-7f098615-a4ff-4fac-a899-f2a0e1049267 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:56:28.964727 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-7f098615-a4ff-4fac-a899-f2a0e1049267 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] [instance: 12704ca3-a417-4cab-9a2c-98b9275218eb] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:56:28.973665 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-7f098615-a4ff-4fac-a899-f2a0e1049267 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:28.974113 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-7f098615-a4ff-4fac-a899-f2a0e1049267 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:28.975955 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-7f098615-a4ff-4fac-a899-f2a0e1049267 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:28.976165 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-7f098615-a4ff-4fac-a899-f2a0e1049267 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:29.034478 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.wsgi [None req-7f098615-a4ff-4fac-a899-f2a0e1049267 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] HTTP exception thrown: Instance 12704ca3-a417-4cab-9a2c-98b9275218eb could not be found. May 12 14:56:29.035415 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-7f098615-a4ff-4fac-a899-f2a0e1049267 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Returning 404 to user: Instance 12704ca3-a417-4cab-9a2c-98b9275218eb could not be found. {{(pid=102212) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 12 14:56:29.036271 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-7f098615-a4ff-4fac-a899-f2a0e1049267 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] 10.222.0.49 "GET /compute/v2.1/servers/12704ca3-a417-4cab-9a2c-98b9275218eb" status: 404 len: 111 microversion: 2.1 time: 0.076979 May 12 14:56:29.047142 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 491/1001] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:56:28 2022] GET /compute/v2.1/servers/12704ca3-a417-4cab-9a2c-98b9275218eb => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 14:56:29.221628 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-97594c02-77b8-4939-bb3b-60e577a0b69f tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-642168005", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1481799217", "security_groups": [{"name": "tempest-secgroup-smoke-1612459297"}], "block_device_mapping_v2": [{"uuid": "11d1928c-fa9e-4f42-8e49-50976391c459", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c8a9b5d7-4b96-4319-809c-e3bf553d8492"}]}} {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:56:29.467957 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.network.neutron [None req-97594c02-77b8-4939-bb3b-60e577a0b69f tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] validate_networks() for [('c8a9b5d7-4b96-4319-809c-e3bf553d8492', None, None, None)] {{(pid=102213) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} May 12 14:56:30.102243 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.virt.hardware [None req-97594c02-77b8-4939-bb3b-60e577a0b69f tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Flavor limits 0:0:0 {{(pid=102213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 14:56:30.102740 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.virt.hardware [None req-97594c02-77b8-4939-bb3b-60e577a0b69f tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Image limits 0:0:0 {{(pid=102213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 14:56:30.103315 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.virt.hardware [None req-97594c02-77b8-4939-bb3b-60e577a0b69f tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Flavor pref 0:0:0 {{(pid=102213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 14:56:30.103791 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.virt.hardware [None req-97594c02-77b8-4939-bb3b-60e577a0b69f tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Image pref 0:0:0 {{(pid=102213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 14:56:30.104271 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.virt.hardware [None req-97594c02-77b8-4939-bb3b-60e577a0b69f tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=102213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 14:56:30.129784 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-97594c02-77b8-4939-bb3b-60e577a0b69f tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:30.130251 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-97594c02-77b8-4939-bb3b-60e577a0b69f tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:30.131134 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-97594c02-77b8-4939-bb3b-60e577a0b69f tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:30.131609 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-97594c02-77b8-4939-bb3b-60e577a0b69f tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:30.152899 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.quota [None req-97594c02-77b8-4939-bb3b-60e577a0b69f tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Getting quotas for project 235689d103ed4d0dbe7b78698395bd21. Resources: {'cores', 'ram', 'instances'} {{(pid=102213) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 12 14:56:30.157143 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.quota [None req-97594c02-77b8-4939-bb3b-60e577a0b69f tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Getting quotas for user fef8036bc3ad4725b3af2607ceb17c88 and project 235689d103ed4d0dbe7b78698395bd21. Resources: {'cores', 'ram', 'instances'} {{(pid=102213) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 12 14:56:30.253827 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-97594c02-77b8-4939-bb3b-60e577a0b69f tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Going to run 1 instances... {{(pid=102213) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 12 14:56:30.255951 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-97594c02-77b8-4939-bb3b-60e577a0b69f tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] [instance: 89809460-5d38-4898-bd05-be5952139ea4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='11d1928c-fa9e-4f42-8e49-50976391c459',volume_size=None,volume_type=None)] {{(pid=102213) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} May 12 14:56:30.761383 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-97594c02-77b8-4939-bb3b-60e577a0b69f tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.543768 May 12 14:56:30.762661 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 511/1002] 10.222.0.49 () {60 vars in 1146 bytes} [Thu May 12 14:56:29 2022] POST /compute/v2.1/servers => generated 406 bytes in 1546 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 14:56:30.780019 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-06e7a911-b009-49e2-ba31-daad6446ab61 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:56:30.780019 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-06e7a911-b009-49e2-ba31-daad6446ab61 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] [instance: 89809460-5d38-4898-bd05-be5952139ea4] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:56:30.876565 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-06e7a911-b009-49e2-ba31-daad6446ab61 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef8036bc3ad4725b3af2607ceb17c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235689d103ed4d0dbe7b78698395bd21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:56:30.886064 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-06e7a911-b009-49e2-ba31-daad6446ab61 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] 10.222.0.49 "GET /compute/v2.1/servers/89809460-5d38-4898-bd05-be5952139ea4" status: 200 len: 1094 microversion: 2.1 time: 0.115675 May 12 14:56:30.886692 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 492/1003] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:56:30 2022] GET /compute/v2.1/servers/89809460-5d38-4898-bd05-be5952139ea4 => generated 1094 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:56:31.904344 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-f0a0b467-0e40-4da9-86c0-288b8596ebe3 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:56:31.905494 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-f0a0b467-0e40-4da9-86c0-288b8596ebe3 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] [instance: 89809460-5d38-4898-bd05-be5952139ea4] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:56:31.915127 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-f0a0b467-0e40-4da9-86c0-288b8596ebe3 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:31.915566 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-f0a0b467-0e40-4da9-86c0-288b8596ebe3 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:31.916339 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-f0a0b467-0e40-4da9-86c0-288b8596ebe3 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:31.916764 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-f0a0b467-0e40-4da9-86c0-288b8596ebe3 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:32.284845 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-f0a0b467-0e40-4da9-86c0-288b8596ebe3 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef8036bc3ad4725b3af2607ceb17c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235689d103ed4d0dbe7b78698395bd21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:56:32.293362 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-f0a0b467-0e40-4da9-86c0-288b8596ebe3 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] 10.222.0.49 "GET /compute/v2.1/servers/89809460-5d38-4898-bd05-be5952139ea4" status: 200 len: 1144 microversion: 2.1 time: 0.394262 May 12 14:56:32.293935 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 512/1004] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:56:31 2022] GET /compute/v2.1/servers/89809460-5d38-4898-bd05-be5952139ea4 => generated 1144 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:56:33.310788 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-94824ee9-367b-4f74-9f6f-9b51fad97967 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:56:33.311452 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-94824ee9-367b-4f74-9f6f-9b51fad97967 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] [instance: 89809460-5d38-4898-bd05-be5952139ea4] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:56:33.320390 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-94824ee9-367b-4f74-9f6f-9b51fad97967 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:33.320843 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-94824ee9-367b-4f74-9f6f-9b51fad97967 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:33.321648 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-94824ee9-367b-4f74-9f6f-9b51fad97967 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:33.322488 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-94824ee9-367b-4f74-9f6f-9b51fad97967 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:33.436511 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-94824ee9-367b-4f74-9f6f-9b51fad97967 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef8036bc3ad4725b3af2607ceb17c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235689d103ed4d0dbe7b78698395bd21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:56:33.445012 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-94824ee9-367b-4f74-9f6f-9b51fad97967 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] 10.222.0.49 "GET /compute/v2.1/servers/89809460-5d38-4898-bd05-be5952139ea4" status: 200 len: 1136 microversion: 2.1 time: 0.137951 May 12 14:56:33.445769 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 493/1005] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:56:33 2022] GET /compute/v2.1/servers/89809460-5d38-4898-bd05-be5952139ea4 => generated 1136 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:56:34.462461 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-2b3e81bd-d22d-4b92-b963-0dd14ba9a7fb tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:56:34.463256 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-2b3e81bd-d22d-4b92-b963-0dd14ba9a7fb tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] [instance: 89809460-5d38-4898-bd05-be5952139ea4] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:56:34.470627 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-2b3e81bd-d22d-4b92-b963-0dd14ba9a7fb tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:34.471110 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-2b3e81bd-d22d-4b92-b963-0dd14ba9a7fb tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:34.471882 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-2b3e81bd-d22d-4b92-b963-0dd14ba9a7fb tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:34.472311 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-2b3e81bd-d22d-4b92-b963-0dd14ba9a7fb tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:34.582041 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-2b3e81bd-d22d-4b92-b963-0dd14ba9a7fb tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef8036bc3ad4725b3af2607ceb17c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235689d103ed4d0dbe7b78698395bd21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:56:34.590542 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-2b3e81bd-d22d-4b92-b963-0dd14ba9a7fb tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] 10.222.0.49 "GET /compute/v2.1/servers/89809460-5d38-4898-bd05-be5952139ea4" status: 200 len: 1136 microversion: 2.1 time: 0.131723 May 12 14:56:34.591139 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 513/1006] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:56:34 2022] GET /compute/v2.1/servers/89809460-5d38-4898-bd05-be5952139ea4 => generated 1136 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:56:35.607546 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-9f31154d-1d2b-4670-a0c3-ac7959de6034 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:56:35.608157 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-9f31154d-1d2b-4670-a0c3-ac7959de6034 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] [instance: 89809460-5d38-4898-bd05-be5952139ea4] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:56:35.616047 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-9f31154d-1d2b-4670-a0c3-ac7959de6034 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:35.616502 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-9f31154d-1d2b-4670-a0c3-ac7959de6034 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:35.617324 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-9f31154d-1d2b-4670-a0c3-ac7959de6034 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:35.617756 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-9f31154d-1d2b-4670-a0c3-ac7959de6034 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:35.736594 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-9f31154d-1d2b-4670-a0c3-ac7959de6034 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef8036bc3ad4725b3af2607ceb17c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235689d103ed4d0dbe7b78698395bd21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:56:35.744860 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-9f31154d-1d2b-4670-a0c3-ac7959de6034 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] 10.222.0.49 "GET /compute/v2.1/servers/89809460-5d38-4898-bd05-be5952139ea4" status: 200 len: 1192 microversion: 2.1 time: 0.140978 May 12 14:56:35.745496 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 494/1007] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:56:35 2022] GET /compute/v2.1/servers/89809460-5d38-4898-bd05-be5952139ea4 => generated 1192 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:56:36.762165 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-e6977eaf-9ec2-4b0e-beb0-01c5aae31064 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:56:36.762983 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-e6977eaf-9ec2-4b0e-beb0-01c5aae31064 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] [instance: 89809460-5d38-4898-bd05-be5952139ea4] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:56:36.770848 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e6977eaf-9ec2-4b0e-beb0-01c5aae31064 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:36.771593 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e6977eaf-9ec2-4b0e-beb0-01c5aae31064 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:36.772485 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e6977eaf-9ec2-4b0e-beb0-01c5aae31064 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:36.773025 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e6977eaf-9ec2-4b0e-beb0-01c5aae31064 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:36.963752 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-e6977eaf-9ec2-4b0e-beb0-01c5aae31064 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef8036bc3ad4725b3af2607ceb17c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235689d103ed4d0dbe7b78698395bd21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:56:36.972925 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-e6977eaf-9ec2-4b0e-beb0-01c5aae31064 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] 10.222.0.49 "GET /compute/v2.1/servers/89809460-5d38-4898-bd05-be5952139ea4" status: 200 len: 1210 microversion: 2.1 time: 0.214425 May 12 14:56:36.973819 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 514/1008] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:56:36 2022] GET /compute/v2.1/servers/89809460-5d38-4898-bd05-be5952139ea4 => generated 1210 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:56:37.997861 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-46bf109c-7b71-4bbd-92f5-f80c3f9645f7 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:56:38.002755 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-46bf109c-7b71-4bbd-92f5-f80c3f9645f7 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] [instance: 89809460-5d38-4898-bd05-be5952139ea4] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:56:38.007577 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-46bf109c-7b71-4bbd-92f5-f80c3f9645f7 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:38.008025 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-46bf109c-7b71-4bbd-92f5-f80c3f9645f7 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:38.008799 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-46bf109c-7b71-4bbd-92f5-f80c3f9645f7 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:38.009236 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-46bf109c-7b71-4bbd-92f5-f80c3f9645f7 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:38.216229 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-46bf109c-7b71-4bbd-92f5-f80c3f9645f7 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef8036bc3ad4725b3af2607ceb17c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235689d103ed4d0dbe7b78698395bd21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:56:38.226906 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-46bf109c-7b71-4bbd-92f5-f80c3f9645f7 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] 10.222.0.49 "GET /compute/v2.1/servers/89809460-5d38-4898-bd05-be5952139ea4" status: 200 len: 1278 microversion: 2.1 time: 0.233036 May 12 14:56:38.228312 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 495/1009] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:56:37 2022] GET /compute/v2.1/servers/89809460-5d38-4898-bd05-be5952139ea4 => generated 1278 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:56:38.835831 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [req-0ae7828c-93c8-437a-9261-c496f594c068 req-303f1fa2-a82d-4dca-a938-2a68b1e6782f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89809460-5d38-4898-bd05-be5952139ea4", "tag": "69fbebb8-e600-4a28-85b5-b354fe5f61f1"}]} {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:56:38.837426 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:56:38.837426 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: warnings.warn(msg) May 12 14:56:38.851568 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [req-0ae7828c-93c8-437a-9261-c496f594c068 req-303f1fa2-a82d-4dca-a938-2a68b1e6782f service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:38.852020 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [req-0ae7828c-93c8-437a-9261-c496f594c068 req-303f1fa2-a82d-4dca-a938-2a68b1e6782f service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:38.869017 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.compute.server_external_events [req-0ae7828c-93c8-437a-9261-c496f594c068 req-303f1fa2-a82d-4dca-a938-2a68b1e6782f service nova] Creating event network-changed:69fbebb8-e600-4a28-85b5-b354fe5f61f1 for instance 89809460-5d38-4898-bd05-be5952139ea4 on hv-cinder-83118 May 12 14:56:38.874030 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [req-0ae7828c-93c8-437a-9261-c496f594c068 req-303f1fa2-a82d-4dca-a938-2a68b1e6782f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041798 May 12 14:56:38.875090 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 515/1010] 10.222.0.49 () {64 vars in 1317 bytes} [Thu May 12 14:56:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:56:39.245391 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-5e3e53d1-de36-4043-92d4-17a7273c668e tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:56:39.247815 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-5e3e53d1-de36-4043-92d4-17a7273c668e tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] [instance: 89809460-5d38-4898-bd05-be5952139ea4] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:56:39.256852 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-5e3e53d1-de36-4043-92d4-17a7273c668e tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:39.258886 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-5e3e53d1-de36-4043-92d4-17a7273c668e tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:39.258886 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-5e3e53d1-de36-4043-92d4-17a7273c668e tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:39.259299 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-5e3e53d1-de36-4043-92d4-17a7273c668e tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:39.466728 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-5e3e53d1-de36-4043-92d4-17a7273c668e tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef8036bc3ad4725b3af2607ceb17c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235689d103ed4d0dbe7b78698395bd21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:56:39.476066 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-5e3e53d1-de36-4043-92d4-17a7273c668e tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] 10.222.0.49 "GET /compute/v2.1/servers/89809460-5d38-4898-bd05-be5952139ea4" status: 200 len: 1266 microversion: 2.1 time: 0.235132 May 12 14:56:39.477024 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 496/1011] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:56:39 2022] GET /compute/v2.1/servers/89809460-5d38-4898-bd05-be5952139ea4 => generated 1266 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:56:40.497956 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-f21d3528-832e-4f82-b3d7-71d1b6b52960 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:56:40.498643 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-f21d3528-832e-4f82-b3d7-71d1b6b52960 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] [instance: 89809460-5d38-4898-bd05-be5952139ea4] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:56:40.506654 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-f21d3528-832e-4f82-b3d7-71d1b6b52960 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:40.507127 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-f21d3528-832e-4f82-b3d7-71d1b6b52960 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:40.507891 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-f21d3528-832e-4f82-b3d7-71d1b6b52960 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:40.508314 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-f21d3528-832e-4f82-b3d7-71d1b6b52960 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:40.560360 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 14:56:40.566278 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: Thu May 12 14:56:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/89809460-5d38-4898-bd05-be5952139ea4 (ip 10.222.0.49) !!! May 12 14:56:40.808595 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-f21d3528-832e-4f82-b3d7-71d1b6b52960 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef8036bc3ad4725b3af2607ceb17c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235689d103ed4d0dbe7b78698395bd21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:56:40.817627 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-f21d3528-832e-4f82-b3d7-71d1b6b52960 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] 10.222.0.49 "GET /compute/v2.1/servers/89809460-5d38-4898-bd05-be5952139ea4" status: 200 len: 1266 microversion: 2.1 time: 0.324000 May 12 14:56:40.818197 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 516/1012] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:56:40 2022] GET /compute/v2.1/servers/89809460-5d38-4898-bd05-be5952139ea4 => generated 1266 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:56:41.834595 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-0da35fb2-b1f0-4167-b1a2-146c9ee728d3 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:56:41.835250 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-0da35fb2-b1f0-4167-b1a2-146c9ee728d3 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] [instance: 89809460-5d38-4898-bd05-be5952139ea4] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:56:41.842591 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-0da35fb2-b1f0-4167-b1a2-146c9ee728d3 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:41.843015 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-0da35fb2-b1f0-4167-b1a2-146c9ee728d3 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:41.844335 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-0da35fb2-b1f0-4167-b1a2-146c9ee728d3 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:41.844768 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-0da35fb2-b1f0-4167-b1a2-146c9ee728d3 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:42.046953 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-0da35fb2-b1f0-4167-b1a2-146c9ee728d3 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef8036bc3ad4725b3af2607ceb17c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235689d103ed4d0dbe7b78698395bd21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:56:42.055369 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-0da35fb2-b1f0-4167-b1a2-146c9ee728d3 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] 10.222.0.49 "GET /compute/v2.1/servers/89809460-5d38-4898-bd05-be5952139ea4" status: 200 len: 1266 microversion: 2.1 time: 0.224265 May 12 14:56:42.055934 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 497/1013] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:56:41 2022] GET /compute/v2.1/servers/89809460-5d38-4898-bd05-be5952139ea4 => generated 1266 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:56:43.072520 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-32ad6a82-e43f-45a0-8e81-dba11dc21b60 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:56:43.073157 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-32ad6a82-e43f-45a0-8e81-dba11dc21b60 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] [instance: 89809460-5d38-4898-bd05-be5952139ea4] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:56:43.080444 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-32ad6a82-e43f-45a0-8e81-dba11dc21b60 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:43.080895 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-32ad6a82-e43f-45a0-8e81-dba11dc21b60 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:43.081720 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-32ad6a82-e43f-45a0-8e81-dba11dc21b60 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:43.082154 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-32ad6a82-e43f-45a0-8e81-dba11dc21b60 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:43.359255 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-32ad6a82-e43f-45a0-8e81-dba11dc21b60 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef8036bc3ad4725b3af2607ceb17c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235689d103ed4d0dbe7b78698395bd21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:56:43.370130 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-32ad6a82-e43f-45a0-8e81-dba11dc21b60 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] 10.222.0.49 "GET /compute/v2.1/servers/89809460-5d38-4898-bd05-be5952139ea4" status: 200 len: 1266 microversion: 2.1 time: 0.301356 May 12 14:56:43.370899 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 517/1014] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:56:43 2022] GET /compute/v2.1/servers/89809460-5d38-4898-bd05-be5952139ea4 => generated 1266 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:56:44.386069 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-7377a9c6-4cc9-4d87-a617-ef7703ae81e9 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:56:44.386865 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-7377a9c6-4cc9-4d87-a617-ef7703ae81e9 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] [instance: 89809460-5d38-4898-bd05-be5952139ea4] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:56:44.394522 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-7377a9c6-4cc9-4d87-a617-ef7703ae81e9 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:44.395134 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-7377a9c6-4cc9-4d87-a617-ef7703ae81e9 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:44.396092 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-7377a9c6-4cc9-4d87-a617-ef7703ae81e9 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:44.396688 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-7377a9c6-4cc9-4d87-a617-ef7703ae81e9 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:44.693352 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-7377a9c6-4cc9-4d87-a617-ef7703ae81e9 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef8036bc3ad4725b3af2607ceb17c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235689d103ed4d0dbe7b78698395bd21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:56:44.702204 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-7377a9c6-4cc9-4d87-a617-ef7703ae81e9 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] 10.222.0.49 "GET /compute/v2.1/servers/89809460-5d38-4898-bd05-be5952139ea4" status: 200 len: 1266 microversion: 2.1 time: 0.319764 May 12 14:56:44.703524 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 498/1015] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:56:44 2022] GET /compute/v2.1/servers/89809460-5d38-4898-bd05-be5952139ea4 => generated 1266 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:56:45.720779 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-798c5cd1-f6a2-4f41-a934-9a53b3e6917e tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:56:45.721391 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-798c5cd1-f6a2-4f41-a934-9a53b3e6917e tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] [instance: 89809460-5d38-4898-bd05-be5952139ea4] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:56:45.729100 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-798c5cd1-f6a2-4f41-a934-9a53b3e6917e tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:45.729630 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-798c5cd1-f6a2-4f41-a934-9a53b3e6917e tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:45.730486 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-798c5cd1-f6a2-4f41-a934-9a53b3e6917e tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:45.731043 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-798c5cd1-f6a2-4f41-a934-9a53b3e6917e tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:45.942952 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-798c5cd1-f6a2-4f41-a934-9a53b3e6917e tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef8036bc3ad4725b3af2607ceb17c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235689d103ed4d0dbe7b78698395bd21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:56:45.950985 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-798c5cd1-f6a2-4f41-a934-9a53b3e6917e tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] 10.222.0.49 "GET /compute/v2.1/servers/89809460-5d38-4898-bd05-be5952139ea4" status: 200 len: 1266 microversion: 2.1 time: 0.234912 May 12 14:56:45.951556 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 518/1016] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:56:45 2022] GET /compute/v2.1/servers/89809460-5d38-4898-bd05-be5952139ea4 => generated 1266 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:56:46.967519 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-a4ec038c-a468-4b89-9922-878f2a2a5c4f tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:56:46.968277 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-a4ec038c-a468-4b89-9922-878f2a2a5c4f tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] [instance: 89809460-5d38-4898-bd05-be5952139ea4] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:56:46.976418 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-a4ec038c-a468-4b89-9922-878f2a2a5c4f tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:46.976944 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-a4ec038c-a468-4b89-9922-878f2a2a5c4f tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:46.978708 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-a4ec038c-a468-4b89-9922-878f2a2a5c4f tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:46.984530 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-a4ec038c-a468-4b89-9922-878f2a2a5c4f tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:47.191388 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-a4ec038c-a468-4b89-9922-878f2a2a5c4f tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef8036bc3ad4725b3af2607ceb17c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235689d103ed4d0dbe7b78698395bd21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:56:47.200706 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-a4ec038c-a468-4b89-9922-878f2a2a5c4f tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] 10.222.0.49 "GET /compute/v2.1/servers/89809460-5d38-4898-bd05-be5952139ea4" status: 200 len: 1266 microversion: 2.1 time: 0.236762 May 12 14:56:47.210900 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 499/1017] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:56:46 2022] GET /compute/v2.1/servers/89809460-5d38-4898-bd05-be5952139ea4 => generated 1266 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:56:48.217335 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-19d912e6-db33-4659-ab8c-9677c3c63a9c tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:56:48.220123 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-19d912e6-db33-4659-ab8c-9677c3c63a9c tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] [instance: 89809460-5d38-4898-bd05-be5952139ea4] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:56:48.228012 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-19d912e6-db33-4659-ab8c-9677c3c63a9c tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:48.228466 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-19d912e6-db33-4659-ab8c-9677c3c63a9c tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:48.229498 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-19d912e6-db33-4659-ab8c-9677c3c63a9c tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:48.230082 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-19d912e6-db33-4659-ab8c-9677c3c63a9c tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:48.427516 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-19d912e6-db33-4659-ab8c-9677c3c63a9c tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef8036bc3ad4725b3af2607ceb17c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235689d103ed4d0dbe7b78698395bd21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:56:48.435886 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-19d912e6-db33-4659-ab8c-9677c3c63a9c tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] 10.222.0.49 "GET /compute/v2.1/servers/89809460-5d38-4898-bd05-be5952139ea4" status: 200 len: 1266 microversion: 2.1 time: 0.222270 May 12 14:56:48.436466 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 519/1018] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:56:48 2022] GET /compute/v2.1/servers/89809460-5d38-4898-bd05-be5952139ea4 => generated 1266 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:56:49.454509 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-bb46e1ab-62c2-45ae-8c06-d4926bd917f2 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:56:49.455770 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-bb46e1ab-62c2-45ae-8c06-d4926bd917f2 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] [instance: 89809460-5d38-4898-bd05-be5952139ea4] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:56:49.473027 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-bb46e1ab-62c2-45ae-8c06-d4926bd917f2 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:49.473027 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-bb46e1ab-62c2-45ae-8c06-d4926bd917f2 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:49.473027 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-bb46e1ab-62c2-45ae-8c06-d4926bd917f2 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:49.473027 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-bb46e1ab-62c2-45ae-8c06-d4926bd917f2 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:49.473803 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [req-b9920d33-06ac-445d-a219-14e4991b9d8c req-fc9133f4-8302-46fc-b7a4-2ee39e6c3c62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89809460-5d38-4898-bd05-be5952139ea4", "name": "network-vif-plugged", "status": "completed", "tag": "69fbebb8-e600-4a28-85b5-b354fe5f61f1"}]} {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:56:49.475613 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:56:49.475613 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: warnings.warn(msg) May 12 14:56:49.485544 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [req-b9920d33-06ac-445d-a219-14e4991b9d8c req-fc9133f4-8302-46fc-b7a4-2ee39e6c3c62 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:49.486070 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [req-b9920d33-06ac-445d-a219-14e4991b9d8c req-fc9133f4-8302-46fc-b7a4-2ee39e6c3c62 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:49.507115 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.compute.server_external_events [req-b9920d33-06ac-445d-a219-14e4991b9d8c req-fc9133f4-8302-46fc-b7a4-2ee39e6c3c62 service nova] Creating event network-vif-plugged:69fbebb8-e600-4a28-85b5-b354fe5f61f1 for instance 89809460-5d38-4898-bd05-be5952139ea4 on hv-cinder-83118 May 12 14:56:49.512568 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [req-b9920d33-06ac-445d-a219-14e4991b9d8c req-fc9133f4-8302-46fc-b7a4-2ee39e6c3c62 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042678 May 12 14:56:49.547365 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 520/1019] 10.222.0.49 () {64 vars in 1317 bytes} [Thu May 12 14:56:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 14:56:49.693095 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-bb46e1ab-62c2-45ae-8c06-d4926bd917f2 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef8036bc3ad4725b3af2607ceb17c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235689d103ed4d0dbe7b78698395bd21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:56:49.702273 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-bb46e1ab-62c2-45ae-8c06-d4926bd917f2 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] 10.222.0.49 "GET /compute/v2.1/servers/89809460-5d38-4898-bd05-be5952139ea4" status: 200 len: 1266 microversion: 2.1 time: 0.253745 May 12 14:56:49.711687 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 500/1020] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:56:49 2022] GET /compute/v2.1/servers/89809460-5d38-4898-bd05-be5952139ea4 => generated 1266 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:56:50.719945 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-aa78bf9a-5ac1-4a6f-ad15-8ce1f19627de tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:56:50.720641 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-aa78bf9a-5ac1-4a6f-ad15-8ce1f19627de tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] [instance: 89809460-5d38-4898-bd05-be5952139ea4] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:56:50.728165 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-aa78bf9a-5ac1-4a6f-ad15-8ce1f19627de tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:50.729715 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-aa78bf9a-5ac1-4a6f-ad15-8ce1f19627de tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:50.729715 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-aa78bf9a-5ac1-4a6f-ad15-8ce1f19627de tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:50.729925 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-aa78bf9a-5ac1-4a6f-ad15-8ce1f19627de tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:50.925826 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-aa78bf9a-5ac1-4a6f-ad15-8ce1f19627de tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef8036bc3ad4725b3af2607ceb17c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235689d103ed4d0dbe7b78698395bd21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:56:50.929850 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-aa78bf9a-5ac1-4a6f-ad15-8ce1f19627de tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] 10.222.0.49 "GET /compute/v2.1/servers/89809460-5d38-4898-bd05-be5952139ea4" status: 200 len: 1266 microversion: 2.1 time: 0.214240 May 12 14:56:50.930416 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 521/1021] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:56:50 2022] GET /compute/v2.1/servers/89809460-5d38-4898-bd05-be5952139ea4 => generated 1266 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:56:51.947093 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-e5eab98e-f2a3-4b30-b808-55ea97bb93c7 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:56:51.947752 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-e5eab98e-f2a3-4b30-b808-55ea97bb93c7 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] [instance: 89809460-5d38-4898-bd05-be5952139ea4] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:56:51.955652 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-e5eab98e-f2a3-4b30-b808-55ea97bb93c7 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:51.956100 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-e5eab98e-f2a3-4b30-b808-55ea97bb93c7 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:51.956924 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-e5eab98e-f2a3-4b30-b808-55ea97bb93c7 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:51.957360 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-e5eab98e-f2a3-4b30-b808-55ea97bb93c7 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:52.152819 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-e5eab98e-f2a3-4b30-b808-55ea97bb93c7 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef8036bc3ad4725b3af2607ceb17c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235689d103ed4d0dbe7b78698395bd21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:56:52.161258 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-e5eab98e-f2a3-4b30-b808-55ea97bb93c7 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] 10.222.0.49 "GET /compute/v2.1/servers/89809460-5d38-4898-bd05-be5952139ea4" status: 200 len: 1454 microversion: 2.1 time: 0.218171 May 12 14:56:52.161823 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 501/1022] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:56:51 2022] GET /compute/v2.1/servers/89809460-5d38-4898-bd05-be5952139ea4 => generated 1454 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:56:52.177376 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-3dbd651c-29f8-4779-a5b6-ec59b354df62 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:56:52.178004 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-3dbd651c-29f8-4779-a5b6-ec59b354df62 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] [instance: 89809460-5d38-4898-bd05-be5952139ea4] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:56:52.185149 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-3dbd651c-29f8-4779-a5b6-ec59b354df62 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:52.185592 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-3dbd651c-29f8-4779-a5b6-ec59b354df62 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:52.186346 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-3dbd651c-29f8-4779-a5b6-ec59b354df62 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:52.186771 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-3dbd651c-29f8-4779-a5b6-ec59b354df62 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:52.391848 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-3dbd651c-29f8-4779-a5b6-ec59b354df62 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef8036bc3ad4725b3af2607ceb17c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235689d103ed4d0dbe7b78698395bd21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:56:52.400279 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-3dbd651c-29f8-4779-a5b6-ec59b354df62 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] 10.222.0.49 "GET /compute/v2.1/servers/89809460-5d38-4898-bd05-be5952139ea4" status: 200 len: 1454 microversion: 2.1 time: 0.226553 May 12 14:56:52.405651 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 522/1023] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:56:52 2022] GET /compute/v2.1/servers/89809460-5d38-4898-bd05-be5952139ea4 => generated 1454 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:56:55.166185 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-3a35ce76-c8e7-4d8e-a01d-801959a2749d tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:56:55.167881 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-3a35ce76-c8e7-4d8e-a01d-801959a2749d tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: 5184e752-c944-4ecd-a516-600944c18dc1] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:56:55.175924 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-3a35ce76-c8e7-4d8e-a01d-801959a2749d tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:55.176377 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-3a35ce76-c8e7-4d8e-a01d-801959a2749d tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:55.177148 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-3a35ce76-c8e7-4d8e-a01d-801959a2749d tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:55.177775 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-3a35ce76-c8e7-4d8e-a01d-801959a2749d tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:55.248753 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-3a35ce76-c8e7-4d8e-a01d-801959a2749d tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.086367 May 12 14:56:55.249319 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 502/1024] 10.222.0.49 () {60 vars in 1342 bytes} [Thu May 12 14:56:55 2022] GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1/os-volume_attachments => generated 25 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:56:55.342527 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-0a6e7db0-b0e4-4581-97a0-d65bf832ef35 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:56:55.345971 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-0a6e7db0-b0e4-4581-97a0-d65bf832ef35 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: 5184e752-c944-4ecd-a516-600944c18dc1] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:56:55.350466 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-0a6e7db0-b0e4-4581-97a0-d65bf832ef35 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:55.350955 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-0a6e7db0-b0e4-4581-97a0-d65bf832ef35 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:55.351720 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-0a6e7db0-b0e4-4581-97a0-d65bf832ef35 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:55.352156 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-0a6e7db0-b0e4-4581-97a0-d65bf832ef35 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:55.419645 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-0a6e7db0-b0e4-4581-97a0-d65bf832ef35 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: 5184e752-c944-4ecd-a516-600944c18dc1] Going to try to terminate instance {{(pid=102213) delete /opt/stack/nova/nova/compute/api.py:2562}} May 12 14:56:55.468680 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [req-8f5bc146-f925-4628-b401-766364309a12 req-547289c0-3728-41a5-9bfb-a871472570eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89809460-5d38-4898-bd05-be5952139ea4", "tag": "69fbebb8-e600-4a28-85b5-b354fe5f61f1"}]} {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:56:55.470172 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:56:55.470172 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: warnings.warn(msg) May 12 14:56:55.479511 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [req-8f5bc146-f925-4628-b401-766364309a12 req-547289c0-3728-41a5-9bfb-a871472570eb service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:55.480245 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [req-8f5bc146-f925-4628-b401-766364309a12 req-547289c0-3728-41a5-9bfb-a871472570eb service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:55.497421 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.compute.server_external_events [req-8f5bc146-f925-4628-b401-766364309a12 req-547289c0-3728-41a5-9bfb-a871472570eb service nova] Creating event network-changed:69fbebb8-e600-4a28-85b5-b354fe5f61f1 for instance 89809460-5d38-4898-bd05-be5952139ea4 on hv-cinder-83118 May 12 14:56:55.502893 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [req-8f5bc146-f925-4628-b401-766364309a12 req-547289c0-3728-41a5-9bfb-a871472570eb service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038034 May 12 14:56:55.506236 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 503/1025] 10.222.0.49 () {64 vars in 1317 bytes} [Thu May 12 14:56:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 14:56:55.826031 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f302d1a2-9f0a-483a-b51b-fb22db80ba3b] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 12 14:56:56.030089 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-0a6e7db0-b0e4-4581-97a0-d65bf832ef35 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "DELETE /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1" status: 204 len: 0 microversion: 2.20 time: 0.690990 May 12 14:56:56.030991 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 523/1026] 10.222.0.49 () {60 vars in 1279 bytes} [Thu May 12 14:56:55 2022] DELETE /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1 => generated 0 bytes in 693 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 12 14:56:56.041238 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-099d2fe2-450d-45fe-a9db-58ca6e97884f tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:56:56.043827 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-099d2fe2-450d-45fe-a9db-58ca6e97884f tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: 5184e752-c944-4ecd-a516-600944c18dc1] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:56:56.058246 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-099d2fe2-450d-45fe-a9db-58ca6e97884f tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:56.061877 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-099d2fe2-450d-45fe-a9db-58ca6e97884f tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:56.065772 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-099d2fe2-450d-45fe-a9db-58ca6e97884f tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:56.066421 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-099d2fe2-450d-45fe-a9db-58ca6e97884f tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:56.318093 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-099d2fe2-450d-45fe-a9db-58ca6e97884f tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:56:56.328162 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-099d2fe2-450d-45fe-a9db-58ca6e97884f tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:56:56.329677 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-099d2fe2-450d-45fe-a9db-58ca6e97884f tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:56:56.330963 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-099d2fe2-450d-45fe-a9db-58ca6e97884f tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1" status: 200 len: 1723 microversion: 2.20 time: 0.294501 May 12 14:56:56.332101 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 504/1027] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:56:56 2022] GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1 => generated 1723 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:56:57.352548 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-1e2bb5c2-f2a7-460b-a003-48e9f8613812 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:56:57.353255 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-1e2bb5c2-f2a7-460b-a003-48e9f8613812 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: 5184e752-c944-4ecd-a516-600944c18dc1] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:56:57.367618 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO oslo.messaging._drivers.impl_rabbit [-] [f302d1a2-9f0a-483a-b51b-fb22db80ba3b] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 42632. May 12 14:56:57.369439 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-1e2bb5c2-f2a7-460b-a003-48e9f8613812 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:57.369895 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-1e2bb5c2-f2a7-460b-a003-48e9f8613812 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:57.370669 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-1e2bb5c2-f2a7-460b-a003-48e9f8613812 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:57.371138 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-1e2bb5c2-f2a7-460b-a003-48e9f8613812 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:57.616855 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-1e2bb5c2-f2a7-460b-a003-48e9f8613812 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:56:57.626330 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-1e2bb5c2-f2a7-460b-a003-48e9f8613812 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:56:57.627839 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-1e2bb5c2-f2a7-460b-a003-48e9f8613812 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:56:57.629039 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-1e2bb5c2-f2a7-460b-a003-48e9f8613812 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1" status: 200 len: 1723 microversion: 2.20 time: 0.281143 May 12 14:56:57.630217 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 524/1028] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:56:57 2022] GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1 => generated 1723 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:56:58.647569 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-a5c9306e-5993-4559-8e95-ec6220c9b057 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:56:58.648216 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-a5c9306e-5993-4559-8e95-ec6220c9b057 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: 5184e752-c944-4ecd-a516-600944c18dc1] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:56:58.655921 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-a5c9306e-5993-4559-8e95-ec6220c9b057 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:58.656375 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-a5c9306e-5993-4559-8e95-ec6220c9b057 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:58.657150 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-a5c9306e-5993-4559-8e95-ec6220c9b057 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:58.657582 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-a5c9306e-5993-4559-8e95-ec6220c9b057 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:58.771862 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-a5c9306e-5993-4559-8e95-ec6220c9b057 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:56:58.781181 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-a5c9306e-5993-4559-8e95-ec6220c9b057 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:56:58.782697 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-a5c9306e-5993-4559-8e95-ec6220c9b057 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:56:58.783873 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-a5c9306e-5993-4559-8e95-ec6220c9b057 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1" status: 200 len: 1655 microversion: 2.20 time: 0.140113 May 12 14:56:58.794722 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 505/1029] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:56:58 2022] GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1 => generated 1655 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:56:59.223478 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [req-831a6f6a-6da8-46ab-85b9-536b6dfdfbaa req-1de72d2e-af24-4985-b916-961f407fddd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5184e752-c944-4ecd-a516-600944c18dc1", "name": "network-vif-deleted", "tag": "74c60ae0-11dc-4a5e-afb9-11e124615006"}]} {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:56:59.225637 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:56:59.225637 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: warnings.warn(msg) May 12 14:56:59.234585 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [req-831a6f6a-6da8-46ab-85b9-536b6dfdfbaa req-1de72d2e-af24-4985-b916-961f407fddd5 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:59.235064 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [req-831a6f6a-6da8-46ab-85b9-536b6dfdfbaa req-1de72d2e-af24-4985-b916-961f407fddd5 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:59.251127 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.compute.server_external_events [req-831a6f6a-6da8-46ab-85b9-536b6dfdfbaa req-1de72d2e-af24-4985-b916-961f407fddd5 service nova] Creating event network-vif-deleted:74c60ae0-11dc-4a5e-afb9-11e124615006 for instance 5184e752-c944-4ecd-a516-600944c18dc1 on hv-cinder-83118 May 12 14:56:59.255940 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [req-831a6f6a-6da8-46ab-85b9-536b6dfdfbaa req-1de72d2e-af24-4985-b916-961f407fddd5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036055 May 12 14:56:59.256713 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 525/1030] 10.222.0.49 () {64 vars in 1317 bytes} [Thu May 12 14:56:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:56:59.802190 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-2c52bf8b-1ada-40be-b7d4-004be1ba89f3 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:56:59.802805 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-2c52bf8b-1ada-40be-b7d4-004be1ba89f3 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: 5184e752-c944-4ecd-a516-600944c18dc1] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:56:59.810303 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-2c52bf8b-1ada-40be-b7d4-004be1ba89f3 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:59.810763 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-2c52bf8b-1ada-40be-b7d4-004be1ba89f3 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:59.811576 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-2c52bf8b-1ada-40be-b7d4-004be1ba89f3 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:59.812051 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-2c52bf8b-1ada-40be-b7d4-004be1ba89f3 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:59.882123 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-2c52bf8b-1ada-40be-b7d4-004be1ba89f3 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:56:59.882440 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-2c52bf8b-1ada-40be-b7d4-004be1ba89f3 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:56:59.882916 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.objects.instance [None req-2c52bf8b-1ada-40be-b7d4-004be1ba89f3 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lazy-loading 'fault' on Instance uuid 5184e752-c944-4ecd-a516-600944c18dc1 {{(pid=102212) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 12 14:56:59.939484 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-2c52bf8b-1ada-40be-b7d4-004be1ba89f3 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:56:59.948136 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-2c52bf8b-1ada-40be-b7d4-004be1ba89f3 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:56:59.949646 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-2c52bf8b-1ada-40be-b7d4-004be1ba89f3 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4214f9e24bfa4f25ae9efbb7fa909300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a45a5191eca43c2b8d3e9ea80a50b5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:56:59.950965 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-2c52bf8b-1ada-40be-b7d4-004be1ba89f3 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1" status: 200 len: 1372 microversion: 2.20 time: 0.152502 May 12 14:56:59.951534 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 506/1031] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:56:59 2022] GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1 => generated 1372 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 12 14:57:00.974581 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-30f5a3e7-d303-48f7-ac72-6d5a282cc3d4 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:57:00.975419 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-30f5a3e7-d303-48f7-ac72-6d5a282cc3d4 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: 5184e752-c944-4ecd-a516-600944c18dc1] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:57:00.982771 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-30f5a3e7-d303-48f7-ac72-6d5a282cc3d4 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:57:00.984539 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-30f5a3e7-d303-48f7-ac72-6d5a282cc3d4 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:57:00.984539 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-30f5a3e7-d303-48f7-ac72-6d5a282cc3d4 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:57:00.984969 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-30f5a3e7-d303-48f7-ac72-6d5a282cc3d4 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:57:01.034681 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.wsgi [None req-30f5a3e7-d303-48f7-ac72-6d5a282cc3d4 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] HTTP exception thrown: Instance 5184e752-c944-4ecd-a516-600944c18dc1 could not be found. May 12 14:57:01.035213 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-30f5a3e7-d303-48f7-ac72-6d5a282cc3d4 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Returning 404 to user: Instance 5184e752-c944-4ecd-a516-600944c18dc1 could not be found. {{(pid=102213) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 12 14:57:01.036287 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-30f5a3e7-d303-48f7-ac72-6d5a282cc3d4 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1" status: 404 len: 111 microversion: 2.20 time: 0.065981 May 12 14:57:01.036824 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 526/1032] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:57:00 2022] GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 12 14:57:01.044954 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-8cc61971-0f63-4973-9ab6-6b2189feb6c9 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '.version_select at 0x7ff77fb2f040>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:57:01.203292 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-8cc61971-0f63-4973-9ab6-6b2189feb6c9 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1387406749" status: 204 len: 0 microversion: 2.20 time: 0.161361 May 12 14:57:01.203900 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 507/1033] 10.222.0.49 () {60 vars in 1261 bytes} [Thu May 12 14:57:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1387406749 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 12 14:57:04.103503 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-a48d5cac-c3b8-43a1-9fb2-24b3c7160889 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:57:04.117827 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-a48d5cac-c3b8-43a1-9fb2-24b3c7160889 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: 5184e752-c944-4ecd-a516-600944c18dc1] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:57:04.117827 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-a48d5cac-c3b8-43a1-9fb2-24b3c7160889 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:57:04.117827 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-a48d5cac-c3b8-43a1-9fb2-24b3c7160889 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:57:04.117827 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-a48d5cac-c3b8-43a1-9fb2-24b3c7160889 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:57:04.118312 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-a48d5cac-c3b8-43a1-9fb2-24b3c7160889 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:57:04.169685 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.wsgi [None req-a48d5cac-c3b8-43a1-9fb2-24b3c7160889 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] HTTP exception thrown: Instance 5184e752-c944-4ecd-a516-600944c18dc1 could not be found. May 12 14:57:04.170558 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-a48d5cac-c3b8-43a1-9fb2-24b3c7160889 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Returning 404 to user: Instance 5184e752-c944-4ecd-a516-600944c18dc1 could not be found. {{(pid=102213) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 12 14:57:04.172160 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-a48d5cac-c3b8-43a1-9fb2-24b3c7160889 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "DELETE /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1" status: 404 len: 111 microversion: 2.20 time: 0.072407 May 12 14:57:04.173235 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 527/1034] 10.222.0.49 () {60 vars in 1279 bytes} [Thu May 12 14:57:04 2022] DELETE /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 12 14:57:04.181090 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-142ef96c-6bab-4899-b7d7-a544ee9107c0 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:57:04.181710 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-142ef96c-6bab-4899-b7d7-a544ee9107c0 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: 5184e752-c944-4ecd-a516-600944c18dc1] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:57:04.190172 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-142ef96c-6bab-4899-b7d7-a544ee9107c0 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:57:04.190620 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-142ef96c-6bab-4899-b7d7-a544ee9107c0 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:57:04.191697 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-142ef96c-6bab-4899-b7d7-a544ee9107c0 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:57:04.192324 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-142ef96c-6bab-4899-b7d7-a544ee9107c0 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:57:04.248995 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.wsgi [None req-142ef96c-6bab-4899-b7d7-a544ee9107c0 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] HTTP exception thrown: Instance 5184e752-c944-4ecd-a516-600944c18dc1 could not be found. May 12 14:57:04.249717 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-142ef96c-6bab-4899-b7d7-a544ee9107c0 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Returning 404 to user: Instance 5184e752-c944-4ecd-a516-600944c18dc1 could not be found. {{(pid=102212) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 12 14:57:04.251091 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-142ef96c-6bab-4899-b7d7-a544ee9107c0 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1" status: 404 len: 111 microversion: 2.20 time: 0.073808 May 12 14:57:04.251650 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 508/1035] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:57:04 2022] GET /compute/v2.1/servers/5184e752-c944-4ecd-a516-600944c18dc1 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 12 14:57:05.728880 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-4f00f3b1-c1b0-4765-8b91-e186305b1bf9 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:57:05.729629 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-4f00f3b1-c1b0-4765-8b91-e186305b1bf9 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:57:05.737507 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-4f00f3b1-c1b0-4765-8b91-e186305b1bf9 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:57:05.738081 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-4f00f3b1-c1b0-4765-8b91-e186305b1bf9 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:57:05.739019 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-4f00f3b1-c1b0-4765-8b91-e186305b1bf9 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:57:05.739667 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-4f00f3b1-c1b0-4765-8b91-e186305b1bf9 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:57:05.794041 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.wsgi [None req-4f00f3b1-c1b0-4765-8b91-e186305b1bf9 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] HTTP exception thrown: Instance a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9 could not be found. May 12 14:57:05.794648 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-4f00f3b1-c1b0-4765-8b91-e186305b1bf9 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Returning 404 to user: Instance a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9 could not be found. {{(pid=102213) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 12 14:57:05.795511 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-4f00f3b1-c1b0-4765-8b91-e186305b1bf9 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "DELETE /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9" status: 404 len: 111 microversion: 2.20 time: 0.070399 May 12 14:57:05.796372 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 528/1036] 10.222.0.49 () {60 vars in 1279 bytes} [Thu May 12 14:57:05 2022] DELETE /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 12 14:57:05.803738 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-fde1a4bb-3deb-4d1a-a96e-e98a0178ea81 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:57:05.804355 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-fde1a4bb-3deb-4d1a-a96e-e98a0178ea81 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] [instance: a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:57:05.811654 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-fde1a4bb-3deb-4d1a-a96e-e98a0178ea81 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:57:05.812140 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-fde1a4bb-3deb-4d1a-a96e-e98a0178ea81 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:57:05.812920 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-fde1a4bb-3deb-4d1a-a96e-e98a0178ea81 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:57:05.813359 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-fde1a4bb-3deb-4d1a-a96e-e98a0178ea81 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:57:05.864299 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.wsgi [None req-fde1a4bb-3deb-4d1a-a96e-e98a0178ea81 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] HTTP exception thrown: Instance a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9 could not be found. May 12 14:57:05.864914 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-fde1a4bb-3deb-4d1a-a96e-e98a0178ea81 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] Returning 404 to user: Instance a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9 could not be found. {{(pid=102212) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 12 14:57:05.865749 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-fde1a4bb-3deb-4d1a-a96e-e98a0178ea81 tempest-AttachVolumeShelveTestJSON-2025716449 tempest-AttachVolumeShelveTestJSON-2025716449-project] 10.222.0.49 "GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9" status: 404 len: 111 microversion: 2.20 time: 0.065760 May 12 14:57:05.866310 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 509/1037] 10.222.0.49 () {60 vars in 1276 bytes} [Thu May 12 14:57:05 2022] GET /compute/v2.1/servers/a0efedd3-ec9f-4ef5-9e1c-2e3beb43dac9 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 12 14:57:15.152010 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-b262f48c-34e6-4e2b-a328-2a5b794148b2 tempest-VolumesSnapshotsTestJSON-2031682877 tempest-VolumesSnapshotsTestJSON-2031682877-project] Action: 'create', calling method: .version_select at 0x7ff77eaf0940>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1209013733"}} {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:57:16.241516 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-b262f48c-34e6-4e2b-a328-2a5b794148b2 tempest-VolumesSnapshotsTestJSON-2031682877 tempest-VolumesSnapshotsTestJSON-2031682877-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 1.349948 May 12 14:57:16.247752 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 529/1038] 10.222.0.49 () {60 vars in 1154 bytes} [Thu May 12 14:57:14 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 1358 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 12 14:57:16.253945 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-71efe0b2-becf-4e3f-a43a-9ad8327081a0 tempest-VolumesSnapshotsTestJSON-2031682877 tempest-VolumesSnapshotsTestJSON-2031682877-project] Calling method '.version_select at 0x7ff77e9473a0>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:57:16.357737 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-71efe0b2-becf-4e3f-a43a-9ad8327081a0 tempest-VolumesSnapshotsTestJSON-2031682877 tempest-VolumesSnapshotsTestJSON-2031682877-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/4171f77b-e764-4e3f-93fa-df25f32585ed" status: 200 len: 345 microversion: 2.1 time: 0.108870 May 12 14:57:16.359214 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 510/1039] 10.222.0.49 () {58 vars in 1244 bytes} [Thu May 12 14:57:16 2022] GET /compute/v2.1/os-volumes/4171f77b-e764-4e3f-93fa-df25f32585ed => generated 345 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 14:57:17.371071 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-a7948337-b378-4061-ac69-9c084b66a56a tempest-VolumesSnapshotsTestJSON-2031682877 tempest-VolumesSnapshotsTestJSON-2031682877-project] Calling method '.version_select at 0x7ff77e7d5040>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:57:17.465632 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-a7948337-b378-4061-ac69-9c084b66a56a tempest-VolumesSnapshotsTestJSON-2031682877 tempest-VolumesSnapshotsTestJSON-2031682877-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/4171f77b-e764-4e3f-93fa-df25f32585ed" status: 200 len: 346 microversion: 2.1 time: 0.098222 May 12 14:57:17.466541 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 530/1040] 10.222.0.49 () {58 vars in 1244 bytes} [Thu May 12 14:57:17 2022] GET /compute/v2.1/os-volumes/4171f77b-e764-4e3f-93fa-df25f32585ed => generated 346 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:57:17.478344 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-77296ef8-6b86-4c2b-8c4c-6db84e514af3 tempest-VolumesSnapshotsTestJSON-2031682877 tempest-VolumesSnapshotsTestJSON-2031682877-project] Action: 'create', calling method: .version_select at 0x7ff77fbdbd30>, body: {"snapshot": {"volume_id": "4171f77b-e764-4e3f-93fa-df25f32585ed", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1627456461"}} {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:57:18.046555 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-77296ef8-6b86-4c2b-8c4c-6db84e514af3 tempest-VolumesSnapshotsTestJSON-2031682877 tempest-VolumesSnapshotsTestJSON-2031682877-project] 10.222.0.49 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.571110 May 12 14:57:18.046555 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 511/1041] 10.222.0.49 () {60 vars in 1161 bytes} [Thu May 12 14:57:17 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 14:57:18.061895 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-415ba38a-cfa4-4ab9-8e5d-f2b10bfc4388 tempest-VolumesSnapshotsTestJSON-2031682877 tempest-VolumesSnapshotsTestJSON-2031682877-project] Calling method '.version_select at 0x7ff77e7d5940>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:57:18.120294 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-415ba38a-cfa4-4ab9-8e5d-f2b10bfc4388 tempest-VolumesSnapshotsTestJSON-2031682877 tempest-VolumesSnapshotsTestJSON-2031682877-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/fdd7b903-f02e-4362-8a9f-e800da421f1d" status: 200 len: 287 microversion: 2.1 time: 0.066843 May 12 14:57:18.126219 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 531/1042] 10.222.0.49 () {58 vars in 1250 bytes} [Thu May 12 14:57:18 2022] GET /compute/v2.1/os-snapshots/fdd7b903-f02e-4362-8a9f-e800da421f1d => generated 287 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:57:18.131407 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-69b1113b-fc85-4692-8515-3b9cffb27729 tempest-VolumesSnapshotsTestJSON-2031682877 tempest-VolumesSnapshotsTestJSON-2031682877-project] Calling method '.version_select at 0x7ff77e5499d0>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:57:18.210590 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-69b1113b-fc85-4692-8515-3b9cffb27729 tempest-VolumesSnapshotsTestJSON-2031682877 tempest-VolumesSnapshotsTestJSON-2031682877-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.081621 May 12 14:57:18.210590 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 512/1043] 10.222.0.49 () {58 vars in 1139 bytes} [Thu May 12 14:57:18 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:57:18.220958 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-ee805c57-247f-4fc2-94a6-b6b60421d3f3 tempest-VolumesSnapshotsTestJSON-2031682877 tempest-VolumesSnapshotsTestJSON-2031682877-project] Calling method '.version_select at 0x7ff77e7d5ca0>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:57:18.279383 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-ee805c57-247f-4fc2-94a6-b6b60421d3f3 tempest-VolumesSnapshotsTestJSON-2031682877 tempest-VolumesSnapshotsTestJSON-2031682877-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/fdd7b903-f02e-4362-8a9f-e800da421f1d" status: 200 len: 287 microversion: 2.1 time: 0.062674 May 12 14:57:18.280791 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 532/1044] 10.222.0.49 () {58 vars in 1250 bytes} [Thu May 12 14:57:18 2022] GET /compute/v2.1/os-snapshots/fdd7b903-f02e-4362-8a9f-e800da421f1d => generated 287 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:57:19.292714 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-78daf34c-6fba-45b2-8732-dc7b64aa54f3 tempest-VolumesSnapshotsTestJSON-2031682877 tempest-VolumesSnapshotsTestJSON-2031682877-project] Calling method '.version_select at 0x7ff77e549430>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:57:19.340738 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-78daf34c-6fba-45b2-8732-dc7b64aa54f3 tempest-VolumesSnapshotsTestJSON-2031682877 tempest-VolumesSnapshotsTestJSON-2031682877-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/fdd7b903-f02e-4362-8a9f-e800da421f1d" status: 200 len: 287 microversion: 2.1 time: 0.051715 May 12 14:57:19.341548 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 513/1045] 10.222.0.49 () {58 vars in 1250 bytes} [Thu May 12 14:57:19 2022] GET /compute/v2.1/os-snapshots/fdd7b903-f02e-4362-8a9f-e800da421f1d => generated 287 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:57:20.353036 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-06ca1ea0-ca71-4546-a43a-c4f5f9780242 tempest-VolumesSnapshotsTestJSON-2031682877 tempest-VolumesSnapshotsTestJSON-2031682877-project] Calling method '.version_select at 0x7ff77e7d53a0>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:57:20.409312 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-06ca1ea0-ca71-4546-a43a-c4f5f9780242 tempest-VolumesSnapshotsTestJSON-2031682877 tempest-VolumesSnapshotsTestJSON-2031682877-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/fdd7b903-f02e-4362-8a9f-e800da421f1d" status: 200 len: 287 microversion: 2.1 time: 0.059889 May 12 14:57:20.415667 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 533/1046] 10.222.0.49 () {58 vars in 1250 bytes} [Thu May 12 14:57:20 2022] GET /compute/v2.1/os-snapshots/fdd7b903-f02e-4362-8a9f-e800da421f1d => generated 287 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:57:21.421965 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-eb9df552-66ce-4d3c-be7b-064a50cc2e46 tempest-VolumesSnapshotsTestJSON-2031682877 tempest-VolumesSnapshotsTestJSON-2031682877-project] Calling method '.version_select at 0x7ff77fb2f940>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:57:21.464738 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-eb9df552-66ce-4d3c-be7b-064a50cc2e46 tempest-VolumesSnapshotsTestJSON-2031682877 tempest-VolumesSnapshotsTestJSON-2031682877-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/fdd7b903-f02e-4362-8a9f-e800da421f1d" status: 200 len: 288 microversion: 2.1 time: 0.047010 May 12 14:57:21.465606 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 514/1047] 10.222.0.49 () {58 vars in 1250 bytes} [Thu May 12 14:57:21 2022] GET /compute/v2.1/os-snapshots/fdd7b903-f02e-4362-8a9f-e800da421f1d => generated 288 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:57:21.478653 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-f0c1a3db-29cf-4c2b-ab33-10bba92d775f tempest-VolumesSnapshotsTestJSON-2031682877 tempest-VolumesSnapshotsTestJSON-2031682877-project] Calling method '.version_select at 0x7ff77eaf0700>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:57:21.697313 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-f0c1a3db-29cf-4c2b-ab33-10bba92d775f tempest-VolumesSnapshotsTestJSON-2031682877 tempest-VolumesSnapshotsTestJSON-2031682877-project] 10.222.0.49 "DELETE /compute/v2.1/os-snapshots/fdd7b903-f02e-4362-8a9f-e800da421f1d" status: 202 len: 0 microversion: 2.1 time: 0.223442 May 12 14:57:21.701072 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 534/1048] 10.222.0.49 () {58 vars in 1253 bytes} [Thu May 12 14:57:21 2022] DELETE /compute/v2.1/os-snapshots/fdd7b903-f02e-4362-8a9f-e800da421f1d => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 14:57:21.706563 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-c5776682-2ab8-4be4-b126-b7287b43de88 tempest-VolumesSnapshotsTestJSON-2031682877 tempest-VolumesSnapshotsTestJSON-2031682877-project] Calling method '.version_select at 0x7ff77fb2f790>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:57:21.765080 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-c5776682-2ab8-4be4-b126-b7287b43de88 tempest-VolumesSnapshotsTestJSON-2031682877 tempest-VolumesSnapshotsTestJSON-2031682877-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/fdd7b903-f02e-4362-8a9f-e800da421f1d" status: 200 len: 287 microversion: 2.1 time: 0.063730 May 12 14:57:21.770164 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 515/1049] 10.222.0.49 () {58 vars in 1250 bytes} [Thu May 12 14:57:21 2022] GET /compute/v2.1/os-snapshots/fdd7b903-f02e-4362-8a9f-e800da421f1d => generated 287 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:57:22.778116 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-35ff7486-a564-4c15-9ab2-efda2644a9e8 tempest-VolumesSnapshotsTestJSON-2031682877 tempest-VolumesSnapshotsTestJSON-2031682877-project] Calling method '.version_select at 0x7ff77eaf0430>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:57:22.831132 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.wsgi [None req-35ff7486-a564-4c15-9ab2-efda2644a9e8 tempest-VolumesSnapshotsTestJSON-2031682877 tempest-VolumesSnapshotsTestJSON-2031682877-project] HTTP exception thrown: Snapshot fdd7b903-f02e-4362-8a9f-e800da421f1d could not be found. May 12 14:57:22.832488 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-35ff7486-a564-4c15-9ab2-efda2644a9e8 tempest-VolumesSnapshotsTestJSON-2031682877 tempest-VolumesSnapshotsTestJSON-2031682877-project] Returning 404 to user: Snapshot fdd7b903-f02e-4362-8a9f-e800da421f1d could not be found. {{(pid=102213) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 12 14:57:22.833353 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-35ff7486-a564-4c15-9ab2-efda2644a9e8 tempest-VolumesSnapshotsTestJSON-2031682877 tempest-VolumesSnapshotsTestJSON-2031682877-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/fdd7b903-f02e-4362-8a9f-e800da421f1d" status: 404 len: 111 microversion: 2.1 time: 0.060423 May 12 14:57:22.834418 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 535/1050] 10.222.0.49 () {58 vars in 1250 bytes} [Thu May 12 14:57:22 2022] GET /compute/v2.1/os-snapshots/fdd7b903-f02e-4362-8a9f-e800da421f1d => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 14:57:22.842441 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-d77e85c8-97ce-4334-9420-dfb0829d423e tempest-VolumesSnapshotsTestJSON-2031682877 tempest-VolumesSnapshotsTestJSON-2031682877-project] Calling method '.version_select at 0x7ff77fbdba60>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:57:23.161107 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-d77e85c8-97ce-4334-9420-dfb0829d423e tempest-VolumesSnapshotsTestJSON-2031682877 tempest-VolumesSnapshotsTestJSON-2031682877-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/4171f77b-e764-4e3f-93fa-df25f32585ed" status: 202 len: 0 microversion: 2.1 time: 0.322536 May 12 14:57:23.162751 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 516/1051] 10.222.0.49 () {58 vars in 1247 bytes} [Thu May 12 14:57:22 2022] DELETE /compute/v2.1/os-volumes/4171f77b-e764-4e3f-93fa-df25f32585ed => generated 0 bytes in 325 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 14:57:23.170222 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-237d879d-f6db-48f6-a6aa-27cc23ff5a07 tempest-VolumesSnapshotsTestJSON-2031682877 tempest-VolumesSnapshotsTestJSON-2031682877-project] Calling method '.version_select at 0x7ff77e7d5dc0>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:57:23.317236 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-237d879d-f6db-48f6-a6aa-27cc23ff5a07 tempest-VolumesSnapshotsTestJSON-2031682877 tempest-VolumesSnapshotsTestJSON-2031682877-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/4171f77b-e764-4e3f-93fa-df25f32585ed" status: 200 len: 345 microversion: 2.1 time: 0.150469 May 12 14:57:23.317906 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 536/1052] 10.222.0.49 () {58 vars in 1244 bytes} [Thu May 12 14:57:23 2022] GET /compute/v2.1/os-volumes/4171f77b-e764-4e3f-93fa-df25f32585ed => generated 345 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:57:24.343319 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-3d8a4924-77c3-4628-a6f7-37df5383015e tempest-VolumesSnapshotsTestJSON-2031682877 tempest-VolumesSnapshotsTestJSON-2031682877-project] Calling method '.version_select at 0x7ff77fb2f670>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:57:24.408327 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.wsgi [None req-3d8a4924-77c3-4628-a6f7-37df5383015e tempest-VolumesSnapshotsTestJSON-2031682877 tempest-VolumesSnapshotsTestJSON-2031682877-project] HTTP exception thrown: Volume 4171f77b-e764-4e3f-93fa-df25f32585ed could not be found. May 12 14:57:24.409041 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-3d8a4924-77c3-4628-a6f7-37df5383015e tempest-VolumesSnapshotsTestJSON-2031682877 tempest-VolumesSnapshotsTestJSON-2031682877-project] Returning 404 to user: Volume 4171f77b-e764-4e3f-93fa-df25f32585ed could not be found. {{(pid=102212) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 12 14:57:24.410127 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-3d8a4924-77c3-4628-a6f7-37df5383015e tempest-VolumesSnapshotsTestJSON-2031682877 tempest-VolumesSnapshotsTestJSON-2031682877-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/4171f77b-e764-4e3f-93fa-df25f32585ed" status: 404 len: 109 microversion: 2.1 time: 0.080540 May 12 14:57:24.410961 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 517/1053] 10.222.0.49 () {58 vars in 1244 bytes} [Thu May 12 14:57:24 2022] GET /compute/v2.1/os-volumes/4171f77b-e764-4e3f-93fa-df25f32585ed => generated 109 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 14:57:24.424928 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-7dd1e1b0-097e-4130-ac06-cd4f41eb36f8 tempest-VolumesSnapshotsTestJSON-2031682877 tempest-VolumesSnapshotsTestJSON-2031682877-project] Calling method '.version_select at 0x7ff77e995c10>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:57:24.484013 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.wsgi [None req-7dd1e1b0-097e-4130-ac06-cd4f41eb36f8 tempest-VolumesSnapshotsTestJSON-2031682877 tempest-VolumesSnapshotsTestJSON-2031682877-project] HTTP exception thrown: Volume 4171f77b-e764-4e3f-93fa-df25f32585ed could not be found. May 12 14:57:24.488810 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-7dd1e1b0-097e-4130-ac06-cd4f41eb36f8 tempest-VolumesSnapshotsTestJSON-2031682877 tempest-VolumesSnapshotsTestJSON-2031682877-project] Returning 404 to user: Volume 4171f77b-e764-4e3f-93fa-df25f32585ed could not be found. {{(pid=102213) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 12 14:57:24.488810 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-7dd1e1b0-097e-4130-ac06-cd4f41eb36f8 tempest-VolumesSnapshotsTestJSON-2031682877 tempest-VolumesSnapshotsTestJSON-2031682877-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/4171f77b-e764-4e3f-93fa-df25f32585ed" status: 404 len: 109 microversion: 2.1 time: 0.064947 May 12 14:57:24.488810 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 537/1054] 10.222.0.49 () {58 vars in 1247 bytes} [Thu May 12 14:57:24 2022] DELETE /compute/v2.1/os-volumes/4171f77b-e764-4e3f-93fa-df25f32585ed => generated 109 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 14:57:24.494543 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-c684328d-dc7a-41ab-a73c-7fb1805da682 tempest-VolumesSnapshotsTestJSON-2031682877 tempest-VolumesSnapshotsTestJSON-2031682877-project] Calling method '.version_select at 0x7ff77ea68550>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:57:24.556653 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.wsgi [None req-c684328d-dc7a-41ab-a73c-7fb1805da682 tempest-VolumesSnapshotsTestJSON-2031682877 tempest-VolumesSnapshotsTestJSON-2031682877-project] HTTP exception thrown: Volume 4171f77b-e764-4e3f-93fa-df25f32585ed could not be found. May 12 14:57:24.557288 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-c684328d-dc7a-41ab-a73c-7fb1805da682 tempest-VolumesSnapshotsTestJSON-2031682877 tempest-VolumesSnapshotsTestJSON-2031682877-project] Returning 404 to user: Volume 4171f77b-e764-4e3f-93fa-df25f32585ed could not be found. {{(pid=102212) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 12 14:57:24.558141 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-c684328d-dc7a-41ab-a73c-7fb1805da682 tempest-VolumesSnapshotsTestJSON-2031682877 tempest-VolumesSnapshotsTestJSON-2031682877-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/4171f77b-e764-4e3f-93fa-df25f32585ed" status: 404 len: 109 microversion: 2.1 time: 0.067791 May 12 14:57:24.558881 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 518/1055] 10.222.0.49 () {58 vars in 1244 bytes} [Thu May 12 14:57:24 2022] GET /compute/v2.1/os-volumes/4171f77b-e764-4e3f-93fa-df25f32585ed => generated 109 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 14:57:36.990669 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-adbeb642-f512-44e3-a0ce-7275f38d5897 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Action: 'create', calling method: .version_select at 0x7ff77eaf0280>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2074245891", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK6UitZlSN+QQKEBUdDeBcJZGXuDUp3lfvgACmbwhxElyzmLhYNn3jjs0zsdVvNmtG5Kas5afePwmbzBbL6j4JctwR49ySrlsaaol7qoJG4Fzf7eH48PH9jDL5BKdb+low=="}} {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:57:37.012348 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.quota [None req-adbeb642-f512-44e3-a0ce-7275f38d5897 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Getting quotas for project 3cf186ac47354ce3ac7681a633be4c2d. Resources: {'key_pairs'} {{(pid=102213) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 12 14:57:37.016201 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.quota [None req-adbeb642-f512-44e3-a0ce-7275f38d5897 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Getting quotas for user 9121971fd3434af6a03ecaaa3ad904f6 and project 3cf186ac47354ce3ac7681a633be4c2d. Resources: {'key_pairs'} {{(pid=102213) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 12 14:57:37.122070 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-adbeb642-f512-44e3-a0ce-7275f38d5897 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.134947 May 12 14:57:37.122658 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 538/1056] 10.222.0.49 () {60 vars in 1158 bytes} [Thu May 12 14:57:36 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:57:37.237286 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: ERROR oslo.messaging._drivers.impl_rabbit [-] [289d8c0f-ae00-419e-9b8f-c41fa206b48c] AMQP server on 10.222.0.49:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 12 14:57:37.240678 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-a66eb3ec-4b3c-4615-ac86-a5881a7feb89 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1386852849", "imageRef": "b5cb9653-8972-4158-a5b6-b4d13046ba8a", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-2074245891", "networks": [{"uuid": "75c099b2-81d1-499f-95a3-b1457697fbc0"}]}} {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:57:37.304276 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.network.neutron [None req-a66eb3ec-4b3c-4615-ac86-a5881a7feb89 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] validate_networks() for [('75c099b2-81d1-499f-95a3-b1457697fbc0', None, None, None)] {{(pid=102212) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} May 12 14:57:37.841789 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.virt.hardware [None req-a66eb3ec-4b3c-4615-ac86-a5881a7feb89 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Flavor limits 0:0:0 {{(pid=102212) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 14:57:37.842217 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.virt.hardware [None req-a66eb3ec-4b3c-4615-ac86-a5881a7feb89 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Image limits 0:0:0 {{(pid=102212) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 14:57:37.842716 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.virt.hardware [None req-a66eb3ec-4b3c-4615-ac86-a5881a7feb89 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Flavor pref 0:0:0 {{(pid=102212) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 14:57:37.843186 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.virt.hardware [None req-a66eb3ec-4b3c-4615-ac86-a5881a7feb89 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Image pref 0:0:0 {{(pid=102212) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 14:57:37.843607 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.virt.hardware [None req-a66eb3ec-4b3c-4615-ac86-a5881a7feb89 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=102212) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 14:57:37.851930 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-a66eb3ec-4b3c-4615-ac86-a5881a7feb89 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:57:37.852374 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-a66eb3ec-4b3c-4615-ac86-a5881a7feb89 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:57:37.853172 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-a66eb3ec-4b3c-4615-ac86-a5881a7feb89 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:57:37.853607 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-a66eb3ec-4b3c-4615-ac86-a5881a7feb89 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:57:37.871778 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.quota [None req-a66eb3ec-4b3c-4615-ac86-a5881a7feb89 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Getting quotas for project 3cf186ac47354ce3ac7681a633be4c2d. Resources: {'cores', 'ram', 'instances'} {{(pid=102212) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 12 14:57:37.876208 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.quota [None req-a66eb3ec-4b3c-4615-ac86-a5881a7feb89 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Getting quotas for user 9121971fd3434af6a03ecaaa3ad904f6 and project 3cf186ac47354ce3ac7681a633be4c2d. Resources: {'cores', 'ram', 'instances'} {{(pid=102212) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 12 14:57:37.886613 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-a66eb3ec-4b3c-4615-ac86-a5881a7feb89 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Going to run 1 instances... {{(pid=102212) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 12 14:57:37.888966 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-a66eb3ec-4b3c-4615-ac86-a5881a7feb89 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] [instance: 2f388082-f6b9-49f0-a128-567d86ccc1ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b5cb9653-8972-4158-a5b6-b4d13046ba8a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=102212) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} May 12 14:57:38.058759 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-a66eb3ec-4b3c-4615-ac86-a5881a7feb89 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.822916 May 12 14:57:38.059433 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 519/1057] 10.222.0.49 () {60 vars in 1146 bytes} [Thu May 12 14:57:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 824 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 14:57:38.070297 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-8f5680f7-e3f2-4927-8fb6-a5afdd2581fd tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:57:38.071202 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-8f5680f7-e3f2-4927-8fb6-a5afdd2581fd tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] [instance: 2f388082-f6b9-49f0-a128-567d86ccc1ab] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:57:38.271739 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-8f5680f7-e3f2-4927-8fb6-a5afdd2581fd tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9121971fd3434af6a03ecaaa3ad904f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf186ac47354ce3ac7681a633be4c2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:57:38.279072 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-8f5680f7-e3f2-4927-8fb6-a5afdd2581fd tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] 10.222.0.49 "GET /compute/v2.1/servers/2f388082-f6b9-49f0-a128-567d86ccc1ab" status: 200 len: 1259 microversion: 2.1 time: 0.212971 May 12 14:57:38.289966 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 539/1058] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:57:38 2022] GET /compute/v2.1/servers/2f388082-f6b9-49f0-a128-567d86ccc1ab => generated 1259 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:57:39.298991 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-616997fd-9b4d-4926-934b-3d2b53074975 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:57:39.299759 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-616997fd-9b4d-4926-934b-3d2b53074975 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] [instance: 2f388082-f6b9-49f0-a128-567d86ccc1ab] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:57:39.313757 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO oslo.messaging._drivers.impl_rabbit [-] [289d8c0f-ae00-419e-9b8f-c41fa206b48c] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 43470. May 12 14:57:39.374665 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-616997fd-9b4d-4926-934b-3d2b53074975 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9121971fd3434af6a03ecaaa3ad904f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf186ac47354ce3ac7681a633be4c2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:57:39.382252 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-616997fd-9b4d-4926-934b-3d2b53074975 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] 10.222.0.49 "GET /compute/v2.1/servers/2f388082-f6b9-49f0-a128-567d86ccc1ab" status: 200 len: 1259 microversion: 2.1 time: 0.089765 May 12 14:57:39.382805 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 520/1059] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:57:39 2022] GET /compute/v2.1/servers/2f388082-f6b9-49f0-a128-567d86ccc1ab => generated 1259 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:57:40.399000 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-c444e261-6ba1-43c8-9c11-2657ef8da3a5 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:57:40.416298 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-c444e261-6ba1-43c8-9c11-2657ef8da3a5 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] [instance: 2f388082-f6b9-49f0-a128-567d86ccc1ab] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:57:40.416298 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-c444e261-6ba1-43c8-9c11-2657ef8da3a5 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:57:40.416298 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-c444e261-6ba1-43c8-9c11-2657ef8da3a5 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:57:40.416298 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-c444e261-6ba1-43c8-9c11-2657ef8da3a5 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:57:40.417166 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-c444e261-6ba1-43c8-9c11-2657ef8da3a5 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:57:40.524164 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-c444e261-6ba1-43c8-9c11-2657ef8da3a5 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9121971fd3434af6a03ecaaa3ad904f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf186ac47354ce3ac7681a633be4c2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:57:40.532394 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-c444e261-6ba1-43c8-9c11-2657ef8da3a5 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] 10.222.0.49 "GET /compute/v2.1/servers/2f388082-f6b9-49f0-a128-567d86ccc1ab" status: 200 len: 1255 microversion: 2.1 time: 0.137232 May 12 14:57:40.532964 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 540/1060] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:57:40 2022] GET /compute/v2.1/servers/2f388082-f6b9-49f0-a128-567d86ccc1ab => generated 1255 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:57:41.552822 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-1818e059-4c30-493a-8fe9-80728f3b8498 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:57:41.553471 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-1818e059-4c30-493a-8fe9-80728f3b8498 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] [instance: 2f388082-f6b9-49f0-a128-567d86ccc1ab] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:57:41.560698 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-1818e059-4c30-493a-8fe9-80728f3b8498 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:57:41.561160 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-1818e059-4c30-493a-8fe9-80728f3b8498 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:57:41.561925 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-1818e059-4c30-493a-8fe9-80728f3b8498 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:57:41.562378 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-1818e059-4c30-493a-8fe9-80728f3b8498 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:57:41.675755 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-1818e059-4c30-493a-8fe9-80728f3b8498 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9121971fd3434af6a03ecaaa3ad904f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf186ac47354ce3ac7681a633be4c2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:57:41.684051 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-1818e059-4c30-493a-8fe9-80728f3b8498 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] 10.222.0.49 "GET /compute/v2.1/servers/2f388082-f6b9-49f0-a128-567d86ccc1ab" status: 200 len: 1319 microversion: 2.1 time: 0.134901 May 12 14:57:41.684630 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 521/1061] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:57:41 2022] GET /compute/v2.1/servers/2f388082-f6b9-49f0-a128-567d86ccc1ab => generated 1319 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:57:42.701106 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-3fbe2b17-3d45-4d09-8878-3b3b4dcc5223 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:57:42.701722 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-3fbe2b17-3d45-4d09-8878-3b3b4dcc5223 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] [instance: 2f388082-f6b9-49f0-a128-567d86ccc1ab] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:57:42.708957 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-3fbe2b17-3d45-4d09-8878-3b3b4dcc5223 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:57:42.709405 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-3fbe2b17-3d45-4d09-8878-3b3b4dcc5223 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:57:42.710175 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-3fbe2b17-3d45-4d09-8878-3b3b4dcc5223 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:57:42.716142 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-3fbe2b17-3d45-4d09-8878-3b3b4dcc5223 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:57:42.833336 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-3fbe2b17-3d45-4d09-8878-3b3b4dcc5223 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9121971fd3434af6a03ecaaa3ad904f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf186ac47354ce3ac7681a633be4c2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:57:42.841418 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-3fbe2b17-3d45-4d09-8878-3b3b4dcc5223 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] 10.222.0.49 "GET /compute/v2.1/servers/2f388082-f6b9-49f0-a128-567d86ccc1ab" status: 200 len: 1319 microversion: 2.1 time: 0.144066 May 12 14:57:42.841987 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 541/1062] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:57:42 2022] GET /compute/v2.1/servers/2f388082-f6b9-49f0-a128-567d86ccc1ab => generated 1319 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:57:43.859374 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-d3b878d2-441d-47e8-aba6-d163bd7007f4 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:57:43.859998 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-d3b878d2-441d-47e8-aba6-d163bd7007f4 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] [instance: 2f388082-f6b9-49f0-a128-567d86ccc1ab] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:57:43.867288 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-d3b878d2-441d-47e8-aba6-d163bd7007f4 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:57:43.867752 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-d3b878d2-441d-47e8-aba6-d163bd7007f4 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:57:43.868532 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-d3b878d2-441d-47e8-aba6-d163bd7007f4 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:57:43.868973 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-d3b878d2-441d-47e8-aba6-d163bd7007f4 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:57:43.982217 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-d3b878d2-441d-47e8-aba6-d163bd7007f4 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9121971fd3434af6a03ecaaa3ad904f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf186ac47354ce3ac7681a633be4c2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:57:43.993528 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-d3b878d2-441d-47e8-aba6-d163bd7007f4 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] 10.222.0.49 "GET /compute/v2.1/servers/2f388082-f6b9-49f0-a128-567d86ccc1ab" status: 200 len: 1329 microversion: 2.1 time: 0.138492 May 12 14:57:43.994426 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 522/1063] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:57:43 2022] GET /compute/v2.1/servers/2f388082-f6b9-49f0-a128-567d86ccc1ab => generated 1329 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:57:45.014611 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-58fb50ab-4253-4013-b1db-ab5b9cbac5db tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:57:45.024097 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-58fb50ab-4253-4013-b1db-ab5b9cbac5db tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] [instance: 2f388082-f6b9-49f0-a128-567d86ccc1ab] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:57:45.024097 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-58fb50ab-4253-4013-b1db-ab5b9cbac5db tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:57:45.024097 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-58fb50ab-4253-4013-b1db-ab5b9cbac5db tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:57:45.025234 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-58fb50ab-4253-4013-b1db-ab5b9cbac5db tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:57:45.025701 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-58fb50ab-4253-4013-b1db-ab5b9cbac5db tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:57:45.681534 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-58fb50ab-4253-4013-b1db-ab5b9cbac5db tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9121971fd3434af6a03ecaaa3ad904f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf186ac47354ce3ac7681a633be4c2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:57:45.690693 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-58fb50ab-4253-4013-b1db-ab5b9cbac5db tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] 10.222.0.49 "GET /compute/v2.1/servers/2f388082-f6b9-49f0-a128-567d86ccc1ab" status: 200 len: 1359 microversion: 2.1 time: 0.679462 May 12 14:57:45.692996 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 542/1064] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:57:45 2022] GET /compute/v2.1/servers/2f388082-f6b9-49f0-a128-567d86ccc1ab => generated 1359 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:57:46.710403 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-0e9c93a6-00b8-441b-a2d0-b351ebe0bc5d tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:57:46.712441 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-0e9c93a6-00b8-441b-a2d0-b351ebe0bc5d tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] [instance: 2f388082-f6b9-49f0-a128-567d86ccc1ab] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:57:46.727873 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-0e9c93a6-00b8-441b-a2d0-b351ebe0bc5d tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:57:46.732641 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-0e9c93a6-00b8-441b-a2d0-b351ebe0bc5d tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:57:46.735301 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-0e9c93a6-00b8-441b-a2d0-b351ebe0bc5d tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:57:46.745640 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-0e9c93a6-00b8-441b-a2d0-b351ebe0bc5d tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:57:47.031474 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [req-b8b912bf-d04c-4356-a173-4cfdabb03857 req-6735d8f3-615b-45f0-be1b-7a06ccc98b42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f388082-f6b9-49f0-a128-567d86ccc1ab", "tag": "e7bdf342-ab8a-4f0c-bc6c-68dc21b7079e"}]} {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:57:47.035496 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:57:47.035496 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: warnings.warn(msg) May 12 14:57:47.046344 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [req-b8b912bf-d04c-4356-a173-4cfdabb03857 req-6735d8f3-615b-45f0-be1b-7a06ccc98b42 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:57:47.047763 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [req-b8b912bf-d04c-4356-a173-4cfdabb03857 req-6735d8f3-615b-45f0-be1b-7a06ccc98b42 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:57:47.054262 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-0e9c93a6-00b8-441b-a2d0-b351ebe0bc5d tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9121971fd3434af6a03ecaaa3ad904f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf186ac47354ce3ac7681a633be4c2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:57:47.069869 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-0e9c93a6-00b8-441b-a2d0-b351ebe0bc5d tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] 10.222.0.49 "GET /compute/v2.1/servers/2f388082-f6b9-49f0-a128-567d86ccc1ab" status: 200 len: 1359 microversion: 2.1 time: 0.363360 May 12 14:57:47.081857 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 523/1065] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:57:46 2022] GET /compute/v2.1/servers/2f388082-f6b9-49f0-a128-567d86ccc1ab => generated 1359 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:57:47.104817 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.compute.server_external_events [req-b8b912bf-d04c-4356-a173-4cfdabb03857 req-6735d8f3-615b-45f0-be1b-7a06ccc98b42 service nova] Creating event network-changed:e7bdf342-ab8a-4f0c-bc6c-68dc21b7079e for instance 2f388082-f6b9-49f0-a128-567d86ccc1ab on hv-cinder-83118 May 12 14:57:47.110258 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [req-b8b912bf-d04c-4356-a173-4cfdabb03857 req-6735d8f3-615b-45f0-be1b-7a06ccc98b42 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083664 May 12 14:57:47.111874 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 543/1066] 10.222.0.49 () {64 vars in 1317 bytes} [Thu May 12 14:57:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:57:48.086947 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-0064c405-49e0-466d-9b51-190954d91867 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:57:48.087545 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-0064c405-49e0-466d-9b51-190954d91867 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] [instance: 2f388082-f6b9-49f0-a128-567d86ccc1ab] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:57:48.095507 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-0064c405-49e0-466d-9b51-190954d91867 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:57:48.095945 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-0064c405-49e0-466d-9b51-190954d91867 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:57:48.096721 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-0064c405-49e0-466d-9b51-190954d91867 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:57:48.097145 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-0064c405-49e0-466d-9b51-190954d91867 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:57:48.329207 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-0064c405-49e0-466d-9b51-190954d91867 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9121971fd3434af6a03ecaaa3ad904f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf186ac47354ce3ac7681a633be4c2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:57:48.338020 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-0064c405-49e0-466d-9b51-190954d91867 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] 10.222.0.49 "GET /compute/v2.1/servers/2f388082-f6b9-49f0-a128-567d86ccc1ab" status: 200 len: 1359 microversion: 2.1 time: 0.254703 May 12 14:57:48.338518 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 524/1067] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:57:48 2022] GET /compute/v2.1/servers/2f388082-f6b9-49f0-a128-567d86ccc1ab => generated 1359 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:57:49.356634 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-4713eaa2-dbaf-4dc9-8516-7cff469ff814 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:57:49.358588 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-4713eaa2-dbaf-4dc9-8516-7cff469ff814 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] [instance: 2f388082-f6b9-49f0-a128-567d86ccc1ab] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:57:49.368552 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-4713eaa2-dbaf-4dc9-8516-7cff469ff814 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:57:49.369257 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-4713eaa2-dbaf-4dc9-8516-7cff469ff814 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:57:49.370268 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-4713eaa2-dbaf-4dc9-8516-7cff469ff814 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:57:49.370767 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-4713eaa2-dbaf-4dc9-8516-7cff469ff814 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:57:49.673525 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-4713eaa2-dbaf-4dc9-8516-7cff469ff814 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9121971fd3434af6a03ecaaa3ad904f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf186ac47354ce3ac7681a633be4c2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:57:49.692512 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-4713eaa2-dbaf-4dc9-8516-7cff469ff814 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] 10.222.0.49 "GET /compute/v2.1/servers/2f388082-f6b9-49f0-a128-567d86ccc1ab" status: 200 len: 1359 microversion: 2.1 time: 0.340605 May 12 14:57:49.693394 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 544/1068] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:57:49 2022] GET /compute/v2.1/servers/2f388082-f6b9-49f0-a128-567d86ccc1ab => generated 1359 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:57:50.709729 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-23acc4bc-aa71-4f03-b32a-ed844dde97c3 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:57:50.710486 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-23acc4bc-aa71-4f03-b32a-ed844dde97c3 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] [instance: 2f388082-f6b9-49f0-a128-567d86ccc1ab] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:57:50.718310 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-23acc4bc-aa71-4f03-b32a-ed844dde97c3 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:57:50.725846 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-23acc4bc-aa71-4f03-b32a-ed844dde97c3 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:57:50.725846 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-23acc4bc-aa71-4f03-b32a-ed844dde97c3 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:57:50.725846 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-23acc4bc-aa71-4f03-b32a-ed844dde97c3 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:57:51.082206 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-23acc4bc-aa71-4f03-b32a-ed844dde97c3 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9121971fd3434af6a03ecaaa3ad904f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf186ac47354ce3ac7681a633be4c2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:57:51.090577 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-23acc4bc-aa71-4f03-b32a-ed844dde97c3 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] 10.222.0.49 "GET /compute/v2.1/servers/2f388082-f6b9-49f0-a128-567d86ccc1ab" status: 200 len: 1359 microversion: 2.1 time: 0.384837 May 12 14:57:51.091173 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 525/1069] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:57:50 2022] GET /compute/v2.1/servers/2f388082-f6b9-49f0-a128-567d86ccc1ab => generated 1359 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:57:52.108814 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-c1b3861b-4910-4641-904b-9ed30f77f7ad tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:57:52.110184 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-c1b3861b-4910-4641-904b-9ed30f77f7ad tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] [instance: 2f388082-f6b9-49f0-a128-567d86ccc1ab] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:57:52.117993 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-c1b3861b-4910-4641-904b-9ed30f77f7ad tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:57:52.118583 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-c1b3861b-4910-4641-904b-9ed30f77f7ad tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:57:52.119519 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-c1b3861b-4910-4641-904b-9ed30f77f7ad tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:57:52.120045 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-c1b3861b-4910-4641-904b-9ed30f77f7ad tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:57:52.344430 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-c1b3861b-4910-4641-904b-9ed30f77f7ad tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9121971fd3434af6a03ecaaa3ad904f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf186ac47354ce3ac7681a633be4c2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:57:52.354082 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-c1b3861b-4910-4641-904b-9ed30f77f7ad tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] 10.222.0.49 "GET /compute/v2.1/servers/2f388082-f6b9-49f0-a128-567d86ccc1ab" status: 200 len: 1359 microversion: 2.1 time: 0.249552 May 12 14:57:52.364877 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 545/1070] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:57:52 2022] GET /compute/v2.1/servers/2f388082-f6b9-49f0-a128-567d86ccc1ab => generated 1359 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:57:53.372350 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-cf758cae-ed91-4c6d-84a2-6a2f392b573f tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:57:53.378702 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-cf758cae-ed91-4c6d-84a2-6a2f392b573f tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] [instance: 2f388082-f6b9-49f0-a128-567d86ccc1ab] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:57:53.382862 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-cf758cae-ed91-4c6d-84a2-6a2f392b573f tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:57:53.383321 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-cf758cae-ed91-4c6d-84a2-6a2f392b573f tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:57:53.384106 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-cf758cae-ed91-4c6d-84a2-6a2f392b573f tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:57:53.384551 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-cf758cae-ed91-4c6d-84a2-6a2f392b573f tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:57:53.591467 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-cf758cae-ed91-4c6d-84a2-6a2f392b573f tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9121971fd3434af6a03ecaaa3ad904f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf186ac47354ce3ac7681a633be4c2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:57:53.600147 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-cf758cae-ed91-4c6d-84a2-6a2f392b573f tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] 10.222.0.49 "GET /compute/v2.1/servers/2f388082-f6b9-49f0-a128-567d86ccc1ab" status: 200 len: 1359 microversion: 2.1 time: 0.231835 May 12 14:57:53.600703 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 526/1071] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:57:53 2022] GET /compute/v2.1/servers/2f388082-f6b9-49f0-a128-567d86ccc1ab => generated 1359 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:57:54.616871 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-97c4fa96-f1f2-4934-a2c5-bbb50e2f5b4d tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:57:54.617626 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-97c4fa96-f1f2-4934-a2c5-bbb50e2f5b4d tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] [instance: 2f388082-f6b9-49f0-a128-567d86ccc1ab] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:57:54.625699 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-97c4fa96-f1f2-4934-a2c5-bbb50e2f5b4d tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:57:54.626147 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-97c4fa96-f1f2-4934-a2c5-bbb50e2f5b4d tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:57:54.626987 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-97c4fa96-f1f2-4934-a2c5-bbb50e2f5b4d tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:57:54.627421 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-97c4fa96-f1f2-4934-a2c5-bbb50e2f5b4d tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:57:54.876203 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-97c4fa96-f1f2-4934-a2c5-bbb50e2f5b4d tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9121971fd3434af6a03ecaaa3ad904f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf186ac47354ce3ac7681a633be4c2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:57:54.884846 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-97c4fa96-f1f2-4934-a2c5-bbb50e2f5b4d tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] 10.222.0.49 "GET /compute/v2.1/servers/2f388082-f6b9-49f0-a128-567d86ccc1ab" status: 200 len: 1359 microversion: 2.1 time: 0.271675 May 12 14:57:54.886854 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 546/1072] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:57:54 2022] GET /compute/v2.1/servers/2f388082-f6b9-49f0-a128-567d86ccc1ab => generated 1359 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:57:55.901613 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-ffca6f4e-1221-4bb0-989d-bce225a63e0b tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:57:55.902254 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-ffca6f4e-1221-4bb0-989d-bce225a63e0b tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] [instance: 2f388082-f6b9-49f0-a128-567d86ccc1ab] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:57:55.909530 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-ffca6f4e-1221-4bb0-989d-bce225a63e0b tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:57:55.910059 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-ffca6f4e-1221-4bb0-989d-bce225a63e0b tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:57:55.910910 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-ffca6f4e-1221-4bb0-989d-bce225a63e0b tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:57:55.911609 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-ffca6f4e-1221-4bb0-989d-bce225a63e0b tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:57:56.115976 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-ffca6f4e-1221-4bb0-989d-bce225a63e0b tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9121971fd3434af6a03ecaaa3ad904f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf186ac47354ce3ac7681a633be4c2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:57:56.124230 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-ffca6f4e-1221-4bb0-989d-bce225a63e0b tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] 10.222.0.49 "GET /compute/v2.1/servers/2f388082-f6b9-49f0-a128-567d86ccc1ab" status: 200 len: 1359 microversion: 2.1 time: 0.226524 May 12 14:57:56.124796 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 527/1073] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:57:55 2022] GET /compute/v2.1/servers/2f388082-f6b9-49f0-a128-567d86ccc1ab => generated 1359 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:57:57.141110 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-b1596b43-4f7c-4447-9878-bb485214802b tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:57:57.141706 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-b1596b43-4f7c-4447-9878-bb485214802b tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] [instance: 2f388082-f6b9-49f0-a128-567d86ccc1ab] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:57:57.148769 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-b1596b43-4f7c-4447-9878-bb485214802b tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:57:57.149214 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-b1596b43-4f7c-4447-9878-bb485214802b tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:57:57.149978 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-b1596b43-4f7c-4447-9878-bb485214802b tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:57:57.150439 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-b1596b43-4f7c-4447-9878-bb485214802b tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:57:57.346220 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-b1596b43-4f7c-4447-9878-bb485214802b tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9121971fd3434af6a03ecaaa3ad904f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf186ac47354ce3ac7681a633be4c2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:57:57.354336 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-b1596b43-4f7c-4447-9878-bb485214802b tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] 10.222.0.49 "GET /compute/v2.1/servers/2f388082-f6b9-49f0-a128-567d86ccc1ab" status: 200 len: 1359 microversion: 2.1 time: 0.217443 May 12 14:57:57.355035 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 547/1074] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:57:57 2022] GET /compute/v2.1/servers/2f388082-f6b9-49f0-a128-567d86ccc1ab => generated 1359 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:57:58.371117 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-5abbfb1f-4dd5-4e59-b419-b373c5794432 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:57:58.372376 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-5abbfb1f-4dd5-4e59-b419-b373c5794432 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] [instance: 2f388082-f6b9-49f0-a128-567d86ccc1ab] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:57:58.379641 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-5abbfb1f-4dd5-4e59-b419-b373c5794432 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:57:58.380091 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-5abbfb1f-4dd5-4e59-b419-b373c5794432 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:57:58.380876 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-5abbfb1f-4dd5-4e59-b419-b373c5794432 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:57:58.381312 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-5abbfb1f-4dd5-4e59-b419-b373c5794432 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:57:58.578169 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-5abbfb1f-4dd5-4e59-b419-b373c5794432 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9121971fd3434af6a03ecaaa3ad904f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf186ac47354ce3ac7681a633be4c2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:57:58.586461 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-5abbfb1f-4dd5-4e59-b419-b373c5794432 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] 10.222.0.49 "GET /compute/v2.1/servers/2f388082-f6b9-49f0-a128-567d86ccc1ab" status: 200 len: 1359 microversion: 2.1 time: 0.218947 May 12 14:57:58.587068 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 528/1075] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:57:58 2022] GET /compute/v2.1/servers/2f388082-f6b9-49f0-a128-567d86ccc1ab => generated 1359 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:57:59.603665 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-99f4792c-c42c-4f7d-97ac-b47b530f9cb1 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:57:59.604425 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-99f4792c-c42c-4f7d-97ac-b47b530f9cb1 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] [instance: 2f388082-f6b9-49f0-a128-567d86ccc1ab] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:57:59.612911 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-99f4792c-c42c-4f7d-97ac-b47b530f9cb1 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:57:59.613353 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-99f4792c-c42c-4f7d-97ac-b47b530f9cb1 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:57:59.614363 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-99f4792c-c42c-4f7d-97ac-b47b530f9cb1 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:57:59.615029 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-99f4792c-c42c-4f7d-97ac-b47b530f9cb1 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:57:59.779536 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [req-5ac63583-3e52-4d3e-b6b0-5bbaf7f938c4 req-8c8cb85c-6287-44b9-8f82-3142e02b9880 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f388082-f6b9-49f0-a128-567d86ccc1ab", "name": "network-vif-plugged", "status": "completed", "tag": "e7bdf342-ab8a-4f0c-bc6c-68dc21b7079e"}]} {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:57:59.781126 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:57:59.781126 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: warnings.warn(msg) May 12 14:57:59.806665 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [req-5ac63583-3e52-4d3e-b6b0-5bbaf7f938c4 req-8c8cb85c-6287-44b9-8f82-3142e02b9880 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:57:59.806665 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [req-5ac63583-3e52-4d3e-b6b0-5bbaf7f938c4 req-8c8cb85c-6287-44b9-8f82-3142e02b9880 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:57:59.809238 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.compute.server_external_events [req-5ac63583-3e52-4d3e-b6b0-5bbaf7f938c4 req-8c8cb85c-6287-44b9-8f82-3142e02b9880 service nova] Creating event network-vif-plugged:e7bdf342-ab8a-4f0c-bc6c-68dc21b7079e for instance 2f388082-f6b9-49f0-a128-567d86ccc1ab on hv-cinder-83118 May 12 14:57:59.814349 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [req-5ac63583-3e52-4d3e-b6b0-5bbaf7f938c4 req-8c8cb85c-6287-44b9-8f82-3142e02b9880 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038436 May 12 14:57:59.814971 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 529/1076] 10.222.0.49 () {64 vars in 1317 bytes} [Thu May 12 14:57:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:57:59.848583 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-99f4792c-c42c-4f7d-97ac-b47b530f9cb1 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9121971fd3434af6a03ecaaa3ad904f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf186ac47354ce3ac7681a633be4c2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:57:59.852392 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-99f4792c-c42c-4f7d-97ac-b47b530f9cb1 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] 10.222.0.49 "GET /compute/v2.1/servers/2f388082-f6b9-49f0-a128-567d86ccc1ab" status: 200 len: 1359 microversion: 2.1 time: 0.252984 May 12 14:57:59.852966 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 548/1077] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:57:59 2022] GET /compute/v2.1/servers/2f388082-f6b9-49f0-a128-567d86ccc1ab => generated 1359 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:58:00.874884 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-7f94044f-a6de-4ae9-99f3-72e7244f2b55 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:58:00.874884 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-7f94044f-a6de-4ae9-99f3-72e7244f2b55 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] [instance: 2f388082-f6b9-49f0-a128-567d86ccc1ab] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:58:00.884155 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-7f94044f-a6de-4ae9-99f3-72e7244f2b55 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:58:00.884668 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-7f94044f-a6de-4ae9-99f3-72e7244f2b55 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:58:00.885704 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-7f94044f-a6de-4ae9-99f3-72e7244f2b55 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:58:00.886338 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-7f94044f-a6de-4ae9-99f3-72e7244f2b55 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:58:01.208381 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-7f94044f-a6de-4ae9-99f3-72e7244f2b55 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9121971fd3434af6a03ecaaa3ad904f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf186ac47354ce3ac7681a633be4c2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:58:01.219971 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-7f94044f-a6de-4ae9-99f3-72e7244f2b55 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] 10.222.0.49 "GET /compute/v2.1/servers/2f388082-f6b9-49f0-a128-567d86ccc1ab" status: 200 len: 1359 microversion: 2.1 time: 0.354153 May 12 14:58:01.230433 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 530/1078] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:58:00 2022] GET /compute/v2.1/servers/2f388082-f6b9-49f0-a128-567d86ccc1ab => generated 1359 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:58:02.238361 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-62e549e2-9aae-4773-b60c-11888333e13a tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:58:02.239334 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-62e549e2-9aae-4773-b60c-11888333e13a tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] [instance: 2f388082-f6b9-49f0-a128-567d86ccc1ab] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:58:02.246954 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-62e549e2-9aae-4773-b60c-11888333e13a tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:58:02.247728 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-62e549e2-9aae-4773-b60c-11888333e13a tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:58:02.248597 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-62e549e2-9aae-4773-b60c-11888333e13a tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:58:02.249026 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-62e549e2-9aae-4773-b60c-11888333e13a tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:58:02.624099 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-62e549e2-9aae-4773-b60c-11888333e13a tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9121971fd3434af6a03ecaaa3ad904f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf186ac47354ce3ac7681a633be4c2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:58:02.633238 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-62e549e2-9aae-4773-b60c-11888333e13a tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] 10.222.0.49 "GET /compute/v2.1/servers/2f388082-f6b9-49f0-a128-567d86ccc1ab" status: 200 len: 1550 microversion: 2.1 time: 0.399027 May 12 14:58:02.634192 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 549/1079] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:58:02 2022] GET /compute/v2.1/servers/2f388082-f6b9-49f0-a128-567d86ccc1ab => generated 1550 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:58:02.649897 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-72099513-0ece-4c81-8df0-3cc010abbaed tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:58:02.652621 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-72099513-0ece-4c81-8df0-3cc010abbaed tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] [instance: 2f388082-f6b9-49f0-a128-567d86ccc1ab] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:58:02.658223 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-72099513-0ece-4c81-8df0-3cc010abbaed tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:58:02.658670 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-72099513-0ece-4c81-8df0-3cc010abbaed tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:58:02.659467 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-72099513-0ece-4c81-8df0-3cc010abbaed tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:58:02.659906 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-72099513-0ece-4c81-8df0-3cc010abbaed tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:58:02.859941 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-72099513-0ece-4c81-8df0-3cc010abbaed tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9121971fd3434af6a03ecaaa3ad904f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf186ac47354ce3ac7681a633be4c2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:58:02.868237 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-72099513-0ece-4c81-8df0-3cc010abbaed tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] 10.222.0.49 "GET /compute/v2.1/servers/2f388082-f6b9-49f0-a128-567d86ccc1ab" status: 200 len: 1550 microversion: 2.1 time: 0.221953 May 12 14:58:02.868813 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 531/1080] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:58:02 2022] GET /compute/v2.1/servers/2f388082-f6b9-49f0-a128-567d86ccc1ab => generated 1550 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:58:02.886256 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-d0879454-30c9-4398-ae13-4b4bfb4d488d tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:58:02.890102 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:58:02.890102 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: warnings.warn(msg) May 12 14:58:02.891102 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-d0879454-30c9-4398-ae13-4b4bfb4d488d tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9121971fd3434af6a03ecaaa3ad904f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf186ac47354ce3ac7681a633be4c2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:58:02.891852 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-d0879454-30c9-4398-ae13-4b4bfb4d488d tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Searching by: {'deleted': False, 'project_id': '3cf186ac47354ce3ac7681a633be4c2d'} {{(pid=102213) get_all /opt/stack/nova/nova/compute/api.py:2855}} May 12 14:58:02.897273 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-d0879454-30c9-4398-ae13-4b4bfb4d488d tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:58:02.897717 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-d0879454-30c9-4398-ae13-4b4bfb4d488d tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:58:02.898521 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-d0879454-30c9-4398-ae13-4b4bfb4d488d tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:58:02.898992 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-d0879454-30c9-4398-ae13-4b4bfb4d488d tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:58:02.989644 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.multi_cell_list [None req-d0879454-30c9-4398-ae13-4b4bfb4d488d tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=102213) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} May 12 14:58:03.082838 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-d0879454-30c9-4398-ae13-4b4bfb4d488d tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] 10.222.0.49 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.200114 May 12 14:58:03.083403 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 550/1081] 10.222.0.49 () {58 vars in 1124 bytes} [Thu May 12 14:58:02 2022] GET /compute/v2.1/servers => generated 343 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:58:03.093480 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-0a1b3b7a-5c6c-4649-bc03-cb00296a2bf8 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:58:03.094123 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-0a1b3b7a-5c6c-4649-bc03-cb00296a2bf8 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] [instance: 2f388082-f6b9-49f0-a128-567d86ccc1ab] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:58:03.101381 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-0a1b3b7a-5c6c-4649-bc03-cb00296a2bf8 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:58:03.101824 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-0a1b3b7a-5c6c-4649-bc03-cb00296a2bf8 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:58:03.102584 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-0a1b3b7a-5c6c-4649-bc03-cb00296a2bf8 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:58:03.103049 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-0a1b3b7a-5c6c-4649-bc03-cb00296a2bf8 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:58:03.318288 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-0a1b3b7a-5c6c-4649-bc03-cb00296a2bf8 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9121971fd3434af6a03ecaaa3ad904f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf186ac47354ce3ac7681a633be4c2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:58:03.326986 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-0a1b3b7a-5c6c-4649-bc03-cb00296a2bf8 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] 10.222.0.49 "GET /compute/v2.1/servers/2f388082-f6b9-49f0-a128-567d86ccc1ab" status: 200 len: 1550 microversion: 2.1 time: 0.236610 May 12 14:58:03.327554 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 532/1082] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:58:03 2022] GET /compute/v2.1/servers/2f388082-f6b9-49f0-a128-567d86ccc1ab => generated 1550 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:58:05.491535 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-a7ff6adb-b372-4852-8081-4e1a53033ff1 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "db1a2175-e623-4786-885d-d4bc1af80bfb"}} {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:58:05.492694 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-a7ff6adb-b372-4852-8081-4e1a53033ff1 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] [instance: 2f388082-f6b9-49f0-a128-567d86ccc1ab] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:58:05.500128 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-a7ff6adb-b372-4852-8081-4e1a53033ff1 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:58:05.500641 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-a7ff6adb-b372-4852-8081-4e1a53033ff1 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:58:05.501475 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-a7ff6adb-b372-4852-8081-4e1a53033ff1 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:58:05.501971 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-a7ff6adb-b372-4852-8081-4e1a53033ff1 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:58:06.916552 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-a7ff6adb-b372-4852-8081-4e1a53033ff1 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] 10.222.0.49 "POST /compute/v2.1/servers/2f388082-f6b9-49f0-a128-567d86ccc1ab/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.428555 May 12 14:58:06.922007 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 551/1083] 10.222.0.49 () {60 vars in 1322 bytes} [Thu May 12 14:58:05 2022] POST /compute/v2.1/servers/2f388082-f6b9-49f0-a128-567d86ccc1ab/os-volume_attachments => generated 194 bytes in 1435 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:58:15.858021 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-aee39f17-6e8c-4c3f-87b9-36c8a4dd9c0c tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:58:15.858638 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-aee39f17-6e8c-4c3f-87b9-36c8a4dd9c0c tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] [instance: 2f388082-f6b9-49f0-a128-567d86ccc1ab] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:58:15.865991 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-aee39f17-6e8c-4c3f-87b9-36c8a4dd9c0c tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:58:15.866378 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-aee39f17-6e8c-4c3f-87b9-36c8a4dd9c0c tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:58:15.867166 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-aee39f17-6e8c-4c3f-87b9-36c8a4dd9c0c tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:58:15.867595 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-aee39f17-6e8c-4c3f-87b9-36c8a4dd9c0c tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:58:16.271953 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-aee39f17-6e8c-4c3f-87b9-36c8a4dd9c0c tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9121971fd3434af6a03ecaaa3ad904f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf186ac47354ce3ac7681a633be4c2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:58:16.281287 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-aee39f17-6e8c-4c3f-87b9-36c8a4dd9c0c tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] 10.222.0.49 "GET /compute/v2.1/servers/2f388082-f6b9-49f0-a128-567d86ccc1ab" status: 200 len: 1596 microversion: 2.1 time: 0.427002 May 12 14:58:16.281835 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 533/1084] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:58:15 2022] GET /compute/v2.1/servers/2f388082-f6b9-49f0-a128-567d86ccc1ab => generated 1596 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:58:19.335677 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [req-7e5d75d4-4327-4acf-9134-a1ddbbeab277 req-7f6821b8-7225-4ba9-8a51-8c8fa79c118d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f388082-f6b9-49f0-a128-567d86ccc1ab", "tag": "e7bdf342-ab8a-4f0c-bc6c-68dc21b7079e"}]} {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:58:19.337153 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:58:19.337153 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: warnings.warn(msg) May 12 14:58:19.346433 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [req-7e5d75d4-4327-4acf-9134-a1ddbbeab277 req-7f6821b8-7225-4ba9-8a51-8c8fa79c118d service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:58:19.347270 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [req-7e5d75d4-4327-4acf-9134-a1ddbbeab277 req-7f6821b8-7225-4ba9-8a51-8c8fa79c118d service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:58:19.365332 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.compute.server_external_events [req-7e5d75d4-4327-4acf-9134-a1ddbbeab277 req-7f6821b8-7225-4ba9-8a51-8c8fa79c118d service nova] Creating event network-changed:e7bdf342-ab8a-4f0c-bc6c-68dc21b7079e for instance 2f388082-f6b9-49f0-a128-567d86ccc1ab on hv-cinder-83118 May 12 14:58:19.370707 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [req-7e5d75d4-4327-4acf-9134-a1ddbbeab277 req-7f6821b8-7225-4ba9-8a51-8c8fa79c118d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039131 May 12 14:58:19.371325 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 552/1085] 10.222.0.49 () {64 vars in 1317 bytes} [Thu May 12 14:58:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:58:23.493075 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-8bc78072-5911-4b6f-b572-b5858ccea4dc tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-498629726"}} {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:58:23.493616 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-8bc78072-5911-4b6f-b572-b5858ccea4dc tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] [instance: 2f388082-f6b9-49f0-a128-567d86ccc1ab] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:58:23.500937 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-8bc78072-5911-4b6f-b572-b5858ccea4dc tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:58:23.501391 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-8bc78072-5911-4b6f-b572-b5858ccea4dc tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:58:23.502153 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-8bc78072-5911-4b6f-b572-b5858ccea4dc tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:58:23.502591 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-8bc78072-5911-4b6f-b572-b5858ccea4dc tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:58:23.698966 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.network.security_group_api [None req-8bc78072-5911-4b6f-b572-b5858ccea4dc tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Adding security group bea1f663-c0df-4d45-be41-465b9c3e4561 to port e7bdf342-ab8a-4f0c-bc6c-68dc21b7079e May 12 14:58:24.401934 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-8bc78072-5911-4b6f-b572-b5858ccea4dc tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] 10.222.0.49 "POST /compute/v2.1/servers/2f388082-f6b9-49f0-a128-567d86ccc1ab/action" status: 202 len: 0 microversion: 2.1 time: 0.912537 May 12 14:58:24.407796 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 534/1086] 10.222.0.49 () {60 vars in 1277 bytes} [Thu May 12 14:58:23 2022] POST /compute/v2.1/servers/2f388082-f6b9-49f0-a128-567d86ccc1ab/action => generated 0 bytes in 919 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 14:58:24.413896 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-052b3955-0348-408c-a575-8aa875b4fd05 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:58:24.414590 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-052b3955-0348-408c-a575-8aa875b4fd05 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] [instance: 2f388082-f6b9-49f0-a128-567d86ccc1ab] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:58:24.421547 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [req-5aa0e212-556b-403e-9660-c4e8de03c009 req-65cbef10-a38c-41b4-931e-76116b5e9f8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f388082-f6b9-49f0-a128-567d86ccc1ab", "tag": "e7bdf342-ab8a-4f0c-bc6c-68dc21b7079e"}]} {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:58:24.423362 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:58:24.423362 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: warnings.warn(msg) May 12 14:58:24.424462 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-052b3955-0348-408c-a575-8aa875b4fd05 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:58:24.425165 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-052b3955-0348-408c-a575-8aa875b4fd05 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:58:24.426204 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-052b3955-0348-408c-a575-8aa875b4fd05 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:58:24.426989 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-052b3955-0348-408c-a575-8aa875b4fd05 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:58:24.434671 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [req-5aa0e212-556b-403e-9660-c4e8de03c009 req-65cbef10-a38c-41b4-931e-76116b5e9f8b service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:58:24.435187 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [req-5aa0e212-556b-403e-9660-c4e8de03c009 req-65cbef10-a38c-41b4-931e-76116b5e9f8b service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:58:24.460219 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.compute.server_external_events [req-5aa0e212-556b-403e-9660-c4e8de03c009 req-65cbef10-a38c-41b4-931e-76116b5e9f8b service nova] Creating event network-changed:e7bdf342-ab8a-4f0c-bc6c-68dc21b7079e for instance 2f388082-f6b9-49f0-a128-567d86ccc1ab on hv-cinder-83118 May 12 14:58:24.465356 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [req-5aa0e212-556b-403e-9660-c4e8de03c009 req-65cbef10-a38c-41b4-931e-76116b5e9f8b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048818 May 12 14:58:24.466321 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 535/1087] 10.222.0.49 () {64 vars in 1317 bytes} [Thu May 12 14:58:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:58:24.926546 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-052b3955-0348-408c-a575-8aa875b4fd05 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9121971fd3434af6a03ecaaa3ad904f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf186ac47354ce3ac7681a633be4c2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:58:24.935264 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-052b3955-0348-408c-a575-8aa875b4fd05 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] 10.222.0.49 "GET /compute/v2.1/servers/2f388082-f6b9-49f0-a128-567d86ccc1ab" status: 200 len: 1761 microversion: 2.1 time: 0.526171 May 12 14:58:24.935989 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 553/1088] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:58:24 2022] GET /compute/v2.1/servers/2f388082-f6b9-49f0-a128-567d86ccc1ab => generated 1761 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:58:32.554988 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 14:58:32.555608 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: Thu May 12 14:58:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 14:58:36.897361 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-b61e073a-35d9-4749-bc3c-bd42ae7cb75e tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:58:36.898418 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-b61e073a-35d9-4749-bc3c-bd42ae7cb75e tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] [instance: 2f388082-f6b9-49f0-a128-567d86ccc1ab] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:58:36.905955 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-b61e073a-35d9-4749-bc3c-bd42ae7cb75e tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:58:36.906407 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-b61e073a-35d9-4749-bc3c-bd42ae7cb75e tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:58:36.907220 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-b61e073a-35d9-4749-bc3c-bd42ae7cb75e tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:58:36.907654 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-b61e073a-35d9-4749-bc3c-bd42ae7cb75e tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:58:37.242683 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-b61e073a-35d9-4749-bc3c-bd42ae7cb75e tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] 10.222.0.49 "POST /compute/v2.1/servers/2f388082-f6b9-49f0-a128-567d86ccc1ab/action" status: 202 len: 0 microversion: 2.1 time: 0.349261 May 12 14:58:37.251096 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 536/1089] 10.222.0.49 () {60 vars in 1277 bytes} [Thu May 12 14:58:36 2022] POST /compute/v2.1/servers/2f388082-f6b9-49f0-a128-567d86ccc1ab/action => generated 0 bytes in 351 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 14:58:37.257685 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-6f0aa78b-bc21-4663-bbaf-6c8dd78c9584 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:58:37.258296 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-6f0aa78b-bc21-4663-bbaf-6c8dd78c9584 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] [instance: 2f388082-f6b9-49f0-a128-567d86ccc1ab] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:58:37.266154 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-6f0aa78b-bc21-4663-bbaf-6c8dd78c9584 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:58:37.266604 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-6f0aa78b-bc21-4663-bbaf-6c8dd78c9584 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:58:37.267419 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-6f0aa78b-bc21-4663-bbaf-6c8dd78c9584 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:58:37.267853 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-6f0aa78b-bc21-4663-bbaf-6c8dd78c9584 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:58:37.460842 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-6f0aa78b-bc21-4663-bbaf-6c8dd78c9584 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9121971fd3434af6a03ecaaa3ad904f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf186ac47354ce3ac7681a633be4c2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:58:37.470037 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-6f0aa78b-bc21-4663-bbaf-6c8dd78c9584 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] 10.222.0.49 "GET /compute/v2.1/servers/2f388082-f6b9-49f0-a128-567d86ccc1ab" status: 200 len: 1753 microversion: 2.1 time: 0.216008 May 12 14:58:37.470593 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 554/1090] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:58:37 2022] GET /compute/v2.1/servers/2f388082-f6b9-49f0-a128-567d86ccc1ab => generated 1753 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:58:38.488574 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-1cab495c-6090-4d3d-acc1-49b7122ee9b3 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:58:38.489207 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-1cab495c-6090-4d3d-acc1-49b7122ee9b3 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] [instance: 2f388082-f6b9-49f0-a128-567d86ccc1ab] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:58:38.496754 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-1cab495c-6090-4d3d-acc1-49b7122ee9b3 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:58:38.497207 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-1cab495c-6090-4d3d-acc1-49b7122ee9b3 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:58:38.497983 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-1cab495c-6090-4d3d-acc1-49b7122ee9b3 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:58:38.498422 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-1cab495c-6090-4d3d-acc1-49b7122ee9b3 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:58:38.692623 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-1cab495c-6090-4d3d-acc1-49b7122ee9b3 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9121971fd3434af6a03ecaaa3ad904f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf186ac47354ce3ac7681a633be4c2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:58:38.701314 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-1cab495c-6090-4d3d-acc1-49b7122ee9b3 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] 10.222.0.49 "GET /compute/v2.1/servers/2f388082-f6b9-49f0-a128-567d86ccc1ab" status: 200 len: 1753 microversion: 2.1 time: 0.217402 May 12 14:58:38.701876 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 537/1091] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:58:38 2022] GET /compute/v2.1/servers/2f388082-f6b9-49f0-a128-567d86ccc1ab => generated 1753 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:58:39.718968 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-d66e8b9b-21a1-484e-ab8b-b060aa4de0fa tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:58:39.719585 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-d66e8b9b-21a1-484e-ab8b-b060aa4de0fa tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] [instance: 2f388082-f6b9-49f0-a128-567d86ccc1ab] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:58:39.727039 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-d66e8b9b-21a1-484e-ab8b-b060aa4de0fa tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:58:39.727495 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-d66e8b9b-21a1-484e-ab8b-b060aa4de0fa tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:58:39.728260 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-d66e8b9b-21a1-484e-ab8b-b060aa4de0fa tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:58:39.728694 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-d66e8b9b-21a1-484e-ab8b-b060aa4de0fa tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:58:40.052065 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-d66e8b9b-21a1-484e-ab8b-b060aa4de0fa tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9121971fd3434af6a03ecaaa3ad904f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf186ac47354ce3ac7681a633be4c2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:58:40.060699 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-d66e8b9b-21a1-484e-ab8b-b060aa4de0fa tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] 10.222.0.49 "GET /compute/v2.1/servers/2f388082-f6b9-49f0-a128-567d86ccc1ab" status: 200 len: 1753 microversion: 2.1 time: 0.345698 May 12 14:58:40.061261 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 555/1092] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:58:39 2022] GET /compute/v2.1/servers/2f388082-f6b9-49f0-a128-567d86ccc1ab => generated 1753 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:58:41.077507 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-71ec255e-bb83-4318-9e5d-818b4d2a5ae9 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:58:41.078126 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-71ec255e-bb83-4318-9e5d-818b4d2a5ae9 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] [instance: 2f388082-f6b9-49f0-a128-567d86ccc1ab] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:58:41.085465 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-71ec255e-bb83-4318-9e5d-818b4d2a5ae9 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:58:41.085955 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-71ec255e-bb83-4318-9e5d-818b4d2a5ae9 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:58:41.086731 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-71ec255e-bb83-4318-9e5d-818b4d2a5ae9 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:58:41.087200 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-71ec255e-bb83-4318-9e5d-818b4d2a5ae9 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:58:41.292849 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-71ec255e-bb83-4318-9e5d-818b4d2a5ae9 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9121971fd3434af6a03ecaaa3ad904f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf186ac47354ce3ac7681a633be4c2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:58:41.302041 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-71ec255e-bb83-4318-9e5d-818b4d2a5ae9 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] 10.222.0.49 "GET /compute/v2.1/servers/2f388082-f6b9-49f0-a128-567d86ccc1ab" status: 200 len: 1758 microversion: 2.1 time: 0.228198 May 12 14:58:41.302600 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 538/1093] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:58:41 2022] GET /compute/v2.1/servers/2f388082-f6b9-49f0-a128-567d86ccc1ab => generated 1758 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:58:42.321026 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-8c397a9d-d77e-431f-8c8d-e1e4bd6636dc tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:58:42.321679 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-8c397a9d-d77e-431f-8c8d-e1e4bd6636dc tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] [instance: 2f388082-f6b9-49f0-a128-567d86ccc1ab] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:58:42.328938 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-8c397a9d-d77e-431f-8c8d-e1e4bd6636dc tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:58:42.329391 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-8c397a9d-d77e-431f-8c8d-e1e4bd6636dc tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:58:42.330164 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-8c397a9d-d77e-431f-8c8d-e1e4bd6636dc tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:58:42.330602 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-8c397a9d-d77e-431f-8c8d-e1e4bd6636dc tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:58:42.531272 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-8c397a9d-d77e-431f-8c8d-e1e4bd6636dc tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9121971fd3434af6a03ecaaa3ad904f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf186ac47354ce3ac7681a633be4c2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:58:42.540385 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-8c397a9d-d77e-431f-8c8d-e1e4bd6636dc tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] 10.222.0.49 "GET /compute/v2.1/servers/2f388082-f6b9-49f0-a128-567d86ccc1ab" status: 200 len: 1758 microversion: 2.1 time: 0.223245 May 12 14:58:42.540943 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 556/1094] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:58:42 2022] GET /compute/v2.1/servers/2f388082-f6b9-49f0-a128-567d86ccc1ab => generated 1758 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:58:43.557355 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-834792f1-9c6e-4192-a3ec-ca6a83adc202 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:58:43.557994 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-834792f1-9c6e-4192-a3ec-ca6a83adc202 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] [instance: 2f388082-f6b9-49f0-a128-567d86ccc1ab] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:58:43.565564 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-834792f1-9c6e-4192-a3ec-ca6a83adc202 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:58:43.566003 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-834792f1-9c6e-4192-a3ec-ca6a83adc202 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:58:43.570923 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-834792f1-9c6e-4192-a3ec-ca6a83adc202 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:58:43.570923 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-834792f1-9c6e-4192-a3ec-ca6a83adc202 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:58:43.767228 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-834792f1-9c6e-4192-a3ec-ca6a83adc202 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9121971fd3434af6a03ecaaa3ad904f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf186ac47354ce3ac7681a633be4c2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:58:43.776025 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-834792f1-9c6e-4192-a3ec-ca6a83adc202 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] 10.222.0.49 "GET /compute/v2.1/servers/2f388082-f6b9-49f0-a128-567d86ccc1ab" status: 200 len: 1758 microversion: 2.1 time: 0.222303 May 12 14:58:43.776730 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 539/1095] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:58:43 2022] GET /compute/v2.1/servers/2f388082-f6b9-49f0-a128-567d86ccc1ab => generated 1758 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:58:44.697129 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-da8aa046-47e8-4d32-b1c7-9ef4f52f3f7e tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-791232677", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1481799217", "security_groups": [{"name": "tempest-secgroup-smoke-1612459297"}], "block_device_mapping_v2": [{"uuid": "29441f66-92a5-4707-96a3-7d3b40def8b5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c8a9b5d7-4b96-4319-809c-e3bf553d8492"}]}} {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:58:44.793088 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-d89988d1-61f4-49ad-837f-1e6bef9858a5 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:58:44.793709 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-d89988d1-61f4-49ad-837f-1e6bef9858a5 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] [instance: 2f388082-f6b9-49f0-a128-567d86ccc1ab] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:58:44.801082 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-d89988d1-61f4-49ad-837f-1e6bef9858a5 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:58:44.801545 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-d89988d1-61f4-49ad-837f-1e6bef9858a5 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:58:44.802331 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-d89988d1-61f4-49ad-837f-1e6bef9858a5 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:58:44.802778 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-d89988d1-61f4-49ad-837f-1e6bef9858a5 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:58:44.839008 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.network.neutron [None req-da8aa046-47e8-4d32-b1c7-9ef4f52f3f7e tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] validate_networks() for [('c8a9b5d7-4b96-4319-809c-e3bf553d8492', None, None, None)] {{(pid=102213) validate_networks /opt/stack/nova/nova/network/neutron.py:2367}} May 12 14:58:45.020907 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-d89988d1-61f4-49ad-837f-1e6bef9858a5 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9121971fd3434af6a03ecaaa3ad904f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf186ac47354ce3ac7681a633be4c2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:58:45.029541 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-d89988d1-61f4-49ad-837f-1e6bef9858a5 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] 10.222.0.49 "GET /compute/v2.1/servers/2f388082-f6b9-49f0-a128-567d86ccc1ab" status: 200 len: 1758 microversion: 2.1 time: 0.239998 May 12 14:58:45.030048 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 540/1096] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:58:44 2022] GET /compute/v2.1/servers/2f388082-f6b9-49f0-a128-567d86ccc1ab => generated 1758 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:58:45.453481 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.virt.hardware [None req-da8aa046-47e8-4d32-b1c7-9ef4f52f3f7e tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Flavor limits 0:0:0 {{(pid=102213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 12 14:58:45.453900 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.virt.hardware [None req-da8aa046-47e8-4d32-b1c7-9ef4f52f3f7e tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Image limits 0:0:0 {{(pid=102213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 12 14:58:45.454399 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.virt.hardware [None req-da8aa046-47e8-4d32-b1c7-9ef4f52f3f7e tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Flavor pref 0:0:0 {{(pid=102213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 12 14:58:45.454804 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.virt.hardware [None req-da8aa046-47e8-4d32-b1c7-9ef4f52f3f7e tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Image pref 0:0:0 {{(pid=102213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 12 14:58:45.455232 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.virt.hardware [None req-da8aa046-47e8-4d32-b1c7-9ef4f52f3f7e tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=102213) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 12 14:58:45.463285 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-da8aa046-47e8-4d32-b1c7-9ef4f52f3f7e tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:58:45.465058 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-da8aa046-47e8-4d32-b1c7-9ef4f52f3f7e tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:58:45.465058 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-da8aa046-47e8-4d32-b1c7-9ef4f52f3f7e tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:58:45.465058 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-da8aa046-47e8-4d32-b1c7-9ef4f52f3f7e tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:58:45.482304 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.quota [None req-da8aa046-47e8-4d32-b1c7-9ef4f52f3f7e tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Getting quotas for project 235689d103ed4d0dbe7b78698395bd21. Resources: {'cores', 'ram', 'instances'} {{(pid=102213) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 12 14:58:45.486918 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.quota [None req-da8aa046-47e8-4d32-b1c7-9ef4f52f3f7e tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Getting quotas for user fef8036bc3ad4725b3af2607ceb17c88 and project 235689d103ed4d0dbe7b78698395bd21. Resources: {'cores', 'ram', 'instances'} {{(pid=102213) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 12 14:58:45.578608 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-da8aa046-47e8-4d32-b1c7-9ef4f52f3f7e tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Going to run 1 instances... {{(pid=102213) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 12 14:58:45.580220 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-da8aa046-47e8-4d32-b1c7-9ef4f52f3f7e tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] [instance: 6f93b678-199d-4978-85cb-d17415606a9c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='29441f66-92a5-4707-96a3-7d3b40def8b5',volume_size=None,volume_type=None)] {{(pid=102213) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} May 12 14:58:46.048039 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-193c8f1e-2931-4022-9a46-dfc6c667dbd6 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:58:46.048657 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-193c8f1e-2931-4022-9a46-dfc6c667dbd6 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] [instance: 2f388082-f6b9-49f0-a128-567d86ccc1ab] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:58:46.055844 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-193c8f1e-2931-4022-9a46-dfc6c667dbd6 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:58:46.056295 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-193c8f1e-2931-4022-9a46-dfc6c667dbd6 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:58:46.057071 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-193c8f1e-2931-4022-9a46-dfc6c667dbd6 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:58:46.057510 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-193c8f1e-2931-4022-9a46-dfc6c667dbd6 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:58:46.212604 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-da8aa046-47e8-4d32-b1c7-9ef4f52f3f7e tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.519215 May 12 14:58:46.218968 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 557/1097] 10.222.0.49 () {60 vars in 1146 bytes} [Thu May 12 14:58:44 2022] POST /compute/v2.1/servers => generated 406 bytes in 1526 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 12 14:58:46.223675 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-e21b8731-dabd-4603-aa90-5aaafff963f8 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:58:46.224343 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-e21b8731-dabd-4603-aa90-5aaafff963f8 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] [instance: 6f93b678-199d-4978-85cb-d17415606a9c] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:58:46.267459 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-193c8f1e-2931-4022-9a46-dfc6c667dbd6 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9121971fd3434af6a03ecaaa3ad904f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf186ac47354ce3ac7681a633be4c2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:58:46.276095 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-193c8f1e-2931-4022-9a46-dfc6c667dbd6 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] 10.222.0.49 "GET /compute/v2.1/servers/2f388082-f6b9-49f0-a128-567d86ccc1ab" status: 200 len: 1758 microversion: 2.1 time: 0.232513 May 12 14:58:46.276785 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 541/1098] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:58:46 2022] GET /compute/v2.1/servers/2f388082-f6b9-49f0-a128-567d86ccc1ab => generated 1758 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:58:46.303702 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-e21b8731-dabd-4603-aa90-5aaafff963f8 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef8036bc3ad4725b3af2607ceb17c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235689d103ed4d0dbe7b78698395bd21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:58:46.310968 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-e21b8731-dabd-4603-aa90-5aaafff963f8 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] 10.222.0.49 "GET /compute/v2.1/servers/6f93b678-199d-4978-85cb-d17415606a9c" status: 200 len: 1094 microversion: 2.1 time: 0.090915 May 12 14:58:46.311562 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 558/1099] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:58:46 2022] GET /compute/v2.1/servers/6f93b678-199d-4978-85cb-d17415606a9c => generated 1094 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:58:47.293788 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-e2f80f63-350d-4966-aeb8-2297376e0b84 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:58:47.294386 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-e2f80f63-350d-4966-aeb8-2297376e0b84 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] [instance: 2f388082-f6b9-49f0-a128-567d86ccc1ab] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:58:47.302490 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-e2f80f63-350d-4966-aeb8-2297376e0b84 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:58:47.302986 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-e2f80f63-350d-4966-aeb8-2297376e0b84 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:58:47.303765 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-e2f80f63-350d-4966-aeb8-2297376e0b84 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:58:47.304198 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-e2f80f63-350d-4966-aeb8-2297376e0b84 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:58:47.327942 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-faa3c7ed-1663-4afc-aa50-ea9f0ed015a4 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:58:47.328565 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-faa3c7ed-1663-4afc-aa50-ea9f0ed015a4 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] [instance: 6f93b678-199d-4978-85cb-d17415606a9c] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:58:47.397607 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-faa3c7ed-1663-4afc-aa50-ea9f0ed015a4 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef8036bc3ad4725b3af2607ceb17c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235689d103ed4d0dbe7b78698395bd21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:58:47.406094 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-faa3c7ed-1663-4afc-aa50-ea9f0ed015a4 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] 10.222.0.49 "GET /compute/v2.1/servers/6f93b678-199d-4978-85cb-d17415606a9c" status: 200 len: 1094 microversion: 2.1 time: 0.081947 May 12 14:58:47.406654 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 559/1100] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:58:47 2022] GET /compute/v2.1/servers/6f93b678-199d-4978-85cb-d17415606a9c => generated 1094 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:58:47.509091 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-e2f80f63-350d-4966-aeb8-2297376e0b84 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9121971fd3434af6a03ecaaa3ad904f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf186ac47354ce3ac7681a633be4c2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:58:47.516679 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-e2f80f63-350d-4966-aeb8-2297376e0b84 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] 10.222.0.49 "GET /compute/v2.1/servers/2f388082-f6b9-49f0-a128-567d86ccc1ab" status: 200 len: 1758 microversion: 2.1 time: 0.226636 May 12 14:58:47.517243 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 542/1101] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:58:47 2022] GET /compute/v2.1/servers/2f388082-f6b9-49f0-a128-567d86ccc1ab => generated 1758 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:58:48.423438 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-9831c0d9-88d7-4e1b-a676-c4c6de293026 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:58:48.424009 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-9831c0d9-88d7-4e1b-a676-c4c6de293026 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] [instance: 6f93b678-199d-4978-85cb-d17415606a9c] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:58:48.431688 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-9831c0d9-88d7-4e1b-a676-c4c6de293026 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:58:48.432743 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-9831c0d9-88d7-4e1b-a676-c4c6de293026 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:58:48.432867 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-9831c0d9-88d7-4e1b-a676-c4c6de293026 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:58:48.433282 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-9831c0d9-88d7-4e1b-a676-c4c6de293026 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:58:48.533595 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-ec02689f-6eae-4113-85e8-09f8e03190de tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:58:48.534262 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-ec02689f-6eae-4113-85e8-09f8e03190de tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] [instance: 2f388082-f6b9-49f0-a128-567d86ccc1ab] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:58:48.541720 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-ec02689f-6eae-4113-85e8-09f8e03190de tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:58:48.542170 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-ec02689f-6eae-4113-85e8-09f8e03190de tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:58:48.542975 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-ec02689f-6eae-4113-85e8-09f8e03190de tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:58:48.543413 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-ec02689f-6eae-4113-85e8-09f8e03190de tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:58:48.551394 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-9831c0d9-88d7-4e1b-a676-c4c6de293026 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef8036bc3ad4725b3af2607ceb17c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235689d103ed4d0dbe7b78698395bd21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:58:48.560053 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-9831c0d9-88d7-4e1b-a676-c4c6de293026 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] 10.222.0.49 "GET /compute/v2.1/servers/6f93b678-199d-4978-85cb-d17415606a9c" status: 200 len: 1192 microversion: 2.1 time: 0.140942 May 12 14:58:48.560713 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 560/1102] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:58:48 2022] GET /compute/v2.1/servers/6f93b678-199d-4978-85cb-d17415606a9c => generated 1192 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:58:48.742127 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-ec02689f-6eae-4113-85e8-09f8e03190de tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9121971fd3434af6a03ecaaa3ad904f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf186ac47354ce3ac7681a633be4c2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:58:48.751276 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-ec02689f-6eae-4113-85e8-09f8e03190de tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] 10.222.0.49 "GET /compute/v2.1/servers/2f388082-f6b9-49f0-a128-567d86ccc1ab" status: 200 len: 1758 microversion: 2.1 time: 0.221394 May 12 14:58:48.751835 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 543/1103] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:58:48 2022] GET /compute/v2.1/servers/2f388082-f6b9-49f0-a128-567d86ccc1ab => generated 1758 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:58:49.577477 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-8756686f-a28e-45d9-a549-adf7ab71fcf3 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:58:49.578352 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-8756686f-a28e-45d9-a549-adf7ab71fcf3 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] [instance: 6f93b678-199d-4978-85cb-d17415606a9c] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:58:49.585832 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-8756686f-a28e-45d9-a549-adf7ab71fcf3 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:58:49.586423 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-8756686f-a28e-45d9-a549-adf7ab71fcf3 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:58:49.587332 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-8756686f-a28e-45d9-a549-adf7ab71fcf3 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:58:49.587894 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-8756686f-a28e-45d9-a549-adf7ab71fcf3 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:58:49.735666 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-8756686f-a28e-45d9-a549-adf7ab71fcf3 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef8036bc3ad4725b3af2607ceb17c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235689d103ed4d0dbe7b78698395bd21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:58:49.743926 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-8756686f-a28e-45d9-a549-adf7ab71fcf3 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] 10.222.0.49 "GET /compute/v2.1/servers/6f93b678-199d-4978-85cb-d17415606a9c" status: 200 len: 1210 microversion: 2.1 time: 0.170101 May 12 14:58:49.744529 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 561/1104] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:58:49 2022] GET /compute/v2.1/servers/6f93b678-199d-4978-85cb-d17415606a9c => generated 1210 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:58:49.768626 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-59890212-6bb8-406c-9b24-84f057763e4b tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:58:49.769330 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-59890212-6bb8-406c-9b24-84f057763e4b tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] [instance: 2f388082-f6b9-49f0-a128-567d86ccc1ab] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:58:49.776659 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-59890212-6bb8-406c-9b24-84f057763e4b tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:58:49.777186 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-59890212-6bb8-406c-9b24-84f057763e4b tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:58:49.778030 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-59890212-6bb8-406c-9b24-84f057763e4b tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:58:49.778537 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-59890212-6bb8-406c-9b24-84f057763e4b tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:58:49.991823 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-59890212-6bb8-406c-9b24-84f057763e4b tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9121971fd3434af6a03ecaaa3ad904f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf186ac47354ce3ac7681a633be4c2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:58:50.001462 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-59890212-6bb8-406c-9b24-84f057763e4b tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] 10.222.0.49 "GET /compute/v2.1/servers/2f388082-f6b9-49f0-a128-567d86ccc1ab" status: 200 len: 1758 microversion: 2.1 time: 0.237063 May 12 14:58:50.002037 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 544/1105] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:58:49 2022] GET /compute/v2.1/servers/2f388082-f6b9-49f0-a128-567d86ccc1ab => generated 1758 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:58:50.761599 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-15615ce3-6d73-4ff4-a999-78b7e31322a9 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:58:50.762910 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-15615ce3-6d73-4ff4-a999-78b7e31322a9 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] [instance: 6f93b678-199d-4978-85cb-d17415606a9c] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:58:50.771438 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-15615ce3-6d73-4ff4-a999-78b7e31322a9 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:58:50.771965 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-15615ce3-6d73-4ff4-a999-78b7e31322a9 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:58:50.772754 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-15615ce3-6d73-4ff4-a999-78b7e31322a9 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:58:50.773197 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-15615ce3-6d73-4ff4-a999-78b7e31322a9 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:58:51.018340 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-9b560694-70bd-4255-8fd8-dbd499ec3fe3 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:58:51.018995 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-9b560694-70bd-4255-8fd8-dbd499ec3fe3 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] [instance: 2f388082-f6b9-49f0-a128-567d86ccc1ab] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:58:51.026112 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-9b560694-70bd-4255-8fd8-dbd499ec3fe3 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:58:51.026566 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-9b560694-70bd-4255-8fd8-dbd499ec3fe3 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:58:51.027381 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-9b560694-70bd-4255-8fd8-dbd499ec3fe3 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:58:51.027823 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-9b560694-70bd-4255-8fd8-dbd499ec3fe3 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:58:51.365747 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-9b560694-70bd-4255-8fd8-dbd499ec3fe3 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9121971fd3434af6a03ecaaa3ad904f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf186ac47354ce3ac7681a633be4c2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:58:51.374942 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-9b560694-70bd-4255-8fd8-dbd499ec3fe3 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] 10.222.0.49 "GET /compute/v2.1/servers/2f388082-f6b9-49f0-a128-567d86ccc1ab" status: 200 len: 1758 microversion: 2.1 time: 0.360150 May 12 14:58:51.376118 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 545/1106] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:58:51 2022] GET /compute/v2.1/servers/2f388082-f6b9-49f0-a128-567d86ccc1ab => generated 1758 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:58:51.424687 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-15615ce3-6d73-4ff4-a999-78b7e31322a9 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef8036bc3ad4725b3af2607ceb17c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235689d103ed4d0dbe7b78698395bd21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:58:51.433254 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-15615ce3-6d73-4ff4-a999-78b7e31322a9 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] 10.222.0.49 "GET /compute/v2.1/servers/6f93b678-199d-4978-85cb-d17415606a9c" status: 200 len: 1278 microversion: 2.1 time: 0.675589 May 12 14:58:51.443216 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 562/1107] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:58:50 2022] GET /compute/v2.1/servers/6f93b678-199d-4978-85cb-d17415606a9c => generated 1278 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:58:51.823536 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [req-7495a315-8362-47d4-aef2-118a6fdb1d6a req-39c5f0cc-2aec-4959-916f-6e7ac8ab2602 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f93b678-199d-4978-85cb-d17415606a9c", "tag": "721835f5-5e78-4b9c-9bf4-202021da902a"}]} {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:58:51.825151 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:58:51.825151 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: warnings.warn(msg) May 12 14:58:51.834035 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [req-7495a315-8362-47d4-aef2-118a6fdb1d6a req-39c5f0cc-2aec-4959-916f-6e7ac8ab2602 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:58:51.834491 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [req-7495a315-8362-47d4-aef2-118a6fdb1d6a req-39c5f0cc-2aec-4959-916f-6e7ac8ab2602 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:58:51.851356 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.compute.server_external_events [req-7495a315-8362-47d4-aef2-118a6fdb1d6a req-39c5f0cc-2aec-4959-916f-6e7ac8ab2602 service nova] Creating event network-changed:721835f5-5e78-4b9c-9bf4-202021da902a for instance 6f93b678-199d-4978-85cb-d17415606a9c on hv-cinder-83118 May 12 14:58:51.856455 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [req-7495a315-8362-47d4-aef2-118a6fdb1d6a req-39c5f0cc-2aec-4959-916f-6e7ac8ab2602 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104795 May 12 14:58:51.857046 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 546/1108] 10.222.0.49 () {64 vars in 1317 bytes} [Thu May 12 14:58:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:58:52.393074 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-25d5f7e8-4243-4ed9-a29c-9577fce4447f tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:58:52.393686 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-25d5f7e8-4243-4ed9-a29c-9577fce4447f tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] [instance: 2f388082-f6b9-49f0-a128-567d86ccc1ab] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:58:52.401189 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-25d5f7e8-4243-4ed9-a29c-9577fce4447f tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:58:52.401649 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-25d5f7e8-4243-4ed9-a29c-9577fce4447f tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:58:52.402420 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-25d5f7e8-4243-4ed9-a29c-9577fce4447f tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:58:52.402885 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-25d5f7e8-4243-4ed9-a29c-9577fce4447f tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:58:52.450889 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-063f061f-f463-4035-9d35-3eeb03fb9603 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:58:52.452884 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-063f061f-f463-4035-9d35-3eeb03fb9603 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] [instance: 6f93b678-199d-4978-85cb-d17415606a9c] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:58:52.459792 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-063f061f-f463-4035-9d35-3eeb03fb9603 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:58:52.460255 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-063f061f-f463-4035-9d35-3eeb03fb9603 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:58:52.461035 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-063f061f-f463-4035-9d35-3eeb03fb9603 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:58:52.461474 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-063f061f-f463-4035-9d35-3eeb03fb9603 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:58:52.657090 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-25d5f7e8-4243-4ed9-a29c-9577fce4447f tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9121971fd3434af6a03ecaaa3ad904f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf186ac47354ce3ac7681a633be4c2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:58:52.667264 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-25d5f7e8-4243-4ed9-a29c-9577fce4447f tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] 10.222.0.49 "GET /compute/v2.1/servers/2f388082-f6b9-49f0-a128-567d86ccc1ab" status: 200 len: 1761 microversion: 2.1 time: 0.278414 May 12 14:58:52.669752 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-063f061f-f463-4035-9d35-3eeb03fb9603 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef8036bc3ad4725b3af2607ceb17c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235689d103ed4d0dbe7b78698395bd21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:58:52.678756 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-063f061f-f463-4035-9d35-3eeb03fb9603 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] 10.222.0.49 "GET /compute/v2.1/servers/6f93b678-199d-4978-85cb-d17415606a9c" status: 200 len: 1266 microversion: 2.1 time: 0.232130 May 12 14:58:52.679187 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 563/1109] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:58:52 2022] GET /compute/v2.1/servers/2f388082-f6b9-49f0-a128-567d86ccc1ab => generated 1761 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:58:52.679714 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 547/1110] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:58:52 2022] GET /compute/v2.1/servers/6f93b678-199d-4978-85cb-d17415606a9c => generated 1266 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 12 14:58:53.696036 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-ccd70fe5-f8a2-46d1-bee7-77a039c29db0 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:58:53.696564 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-ccd70fe5-f8a2-46d1-bee7-77a039c29db0 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] [instance: 6f93b678-199d-4978-85cb-d17415606a9c] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:58:53.704365 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-ccd70fe5-f8a2-46d1-bee7-77a039c29db0 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:58:53.704811 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-ccd70fe5-f8a2-46d1-bee7-77a039c29db0 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:58:53.705588 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-ccd70fe5-f8a2-46d1-bee7-77a039c29db0 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:58:53.706026 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-ccd70fe5-f8a2-46d1-bee7-77a039c29db0 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:58:53.903228 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-ccd70fe5-f8a2-46d1-bee7-77a039c29db0 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef8036bc3ad4725b3af2607ceb17c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235689d103ed4d0dbe7b78698395bd21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:58:53.912298 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-ccd70fe5-f8a2-46d1-bee7-77a039c29db0 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] 10.222.0.49 "GET /compute/v2.1/servers/6f93b678-199d-4978-85cb-d17415606a9c" status: 200 len: 1266 microversion: 2.1 time: 0.220043 May 12 14:58:53.912859 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 564/1111] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:58:53 2022] GET /compute/v2.1/servers/6f93b678-199d-4978-85cb-d17415606a9c => generated 1266 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:58:54.929099 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-a4255586-7623-43ea-90d5-490811503e7e tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:58:54.929725 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-a4255586-7623-43ea-90d5-490811503e7e tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] [instance: 6f93b678-199d-4978-85cb-d17415606a9c] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:58:54.936865 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-a4255586-7623-43ea-90d5-490811503e7e tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:58:54.937312 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-a4255586-7623-43ea-90d5-490811503e7e tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:58:54.938077 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-a4255586-7623-43ea-90d5-490811503e7e tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:58:54.938508 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-a4255586-7623-43ea-90d5-490811503e7e tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:58:55.133595 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-a4255586-7623-43ea-90d5-490811503e7e tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef8036bc3ad4725b3af2607ceb17c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235689d103ed4d0dbe7b78698395bd21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:58:55.142707 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-a4255586-7623-43ea-90d5-490811503e7e tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] 10.222.0.49 "GET /compute/v2.1/servers/6f93b678-199d-4978-85cb-d17415606a9c" status: 200 len: 1266 microversion: 2.1 time: 0.217422 May 12 14:58:55.143306 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 548/1112] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:58:54 2022] GET /compute/v2.1/servers/6f93b678-199d-4978-85cb-d17415606a9c => generated 1266 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:58:56.159888 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-f30b8413-515b-4e74-9cc6-7798856dbbd9 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:58:56.160479 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-f30b8413-515b-4e74-9cc6-7798856dbbd9 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] [instance: 6f93b678-199d-4978-85cb-d17415606a9c] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:58:56.168185 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-f30b8413-515b-4e74-9cc6-7798856dbbd9 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:58:56.168629 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-f30b8413-515b-4e74-9cc6-7798856dbbd9 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:58:56.169383 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-f30b8413-515b-4e74-9cc6-7798856dbbd9 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:58:56.169808 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-f30b8413-515b-4e74-9cc6-7798856dbbd9 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:58:56.362294 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-f30b8413-515b-4e74-9cc6-7798856dbbd9 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef8036bc3ad4725b3af2607ceb17c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235689d103ed4d0dbe7b78698395bd21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:58:56.370358 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-f30b8413-515b-4e74-9cc6-7798856dbbd9 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] 10.222.0.49 "GET /compute/v2.1/servers/6f93b678-199d-4978-85cb-d17415606a9c" status: 200 len: 1266 microversion: 2.1 time: 0.214700 May 12 14:58:56.371309 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 565/1113] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:58:56 2022] GET /compute/v2.1/servers/6f93b678-199d-4978-85cb-d17415606a9c => generated 1266 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:58:57.387346 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-09747841-d78a-4af1-a985-d3fd57462d6f tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:58:57.387963 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-09747841-d78a-4af1-a985-d3fd57462d6f tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] [instance: 6f93b678-199d-4978-85cb-d17415606a9c] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:58:57.395799 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-09747841-d78a-4af1-a985-d3fd57462d6f tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:58:57.396251 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-09747841-d78a-4af1-a985-d3fd57462d6f tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:58:57.397022 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-09747841-d78a-4af1-a985-d3fd57462d6f tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:58:57.397458 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-09747841-d78a-4af1-a985-d3fd57462d6f tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:58:57.591651 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-09747841-d78a-4af1-a985-d3fd57462d6f tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef8036bc3ad4725b3af2607ceb17c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235689d103ed4d0dbe7b78698395bd21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:58:57.599773 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-09747841-d78a-4af1-a985-d3fd57462d6f tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] 10.222.0.49 "GET /compute/v2.1/servers/6f93b678-199d-4978-85cb-d17415606a9c" status: 200 len: 1266 microversion: 2.1 time: 0.216119 May 12 14:58:57.600322 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 549/1114] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:58:57 2022] GET /compute/v2.1/servers/6f93b678-199d-4978-85cb-d17415606a9c => generated 1266 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:58:58.616579 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-34c06c4d-bbb8-4365-bcb1-373cdd9c2f29 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:58:58.617154 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-34c06c4d-bbb8-4365-bcb1-373cdd9c2f29 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] [instance: 6f93b678-199d-4978-85cb-d17415606a9c] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:58:58.626428 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-34c06c4d-bbb8-4365-bcb1-373cdd9c2f29 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:58:58.626428 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-34c06c4d-bbb8-4365-bcb1-373cdd9c2f29 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:58:58.626428 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-34c06c4d-bbb8-4365-bcb1-373cdd9c2f29 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:58:58.626428 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-34c06c4d-bbb8-4365-bcb1-373cdd9c2f29 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:58:58.819957 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-34c06c4d-bbb8-4365-bcb1-373cdd9c2f29 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef8036bc3ad4725b3af2607ceb17c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235689d103ed4d0dbe7b78698395bd21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:58:58.828050 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-34c06c4d-bbb8-4365-bcb1-373cdd9c2f29 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] 10.222.0.49 "GET /compute/v2.1/servers/6f93b678-199d-4978-85cb-d17415606a9c" status: 200 len: 1266 microversion: 2.1 time: 0.215424 May 12 14:58:58.829182 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 566/1115] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:58:58 2022] GET /compute/v2.1/servers/6f93b678-199d-4978-85cb-d17415606a9c => generated 1266 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:58:59.845252 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-8b8f1d54-18e6-41d8-b2d4-165250d26ec5 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:58:59.845786 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-8b8f1d54-18e6-41d8-b2d4-165250d26ec5 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] [instance: 6f93b678-199d-4978-85cb-d17415606a9c] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:58:59.853079 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-8b8f1d54-18e6-41d8-b2d4-165250d26ec5 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:58:59.853527 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-8b8f1d54-18e6-41d8-b2d4-165250d26ec5 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:58:59.854428 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-8b8f1d54-18e6-41d8-b2d4-165250d26ec5 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:58:59.854934 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-8b8f1d54-18e6-41d8-b2d4-165250d26ec5 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:59:00.049720 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-8b8f1d54-18e6-41d8-b2d4-165250d26ec5 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef8036bc3ad4725b3af2607ceb17c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235689d103ed4d0dbe7b78698395bd21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:59:00.057954 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-8b8f1d54-18e6-41d8-b2d4-165250d26ec5 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] 10.222.0.49 "GET /compute/v2.1/servers/6f93b678-199d-4978-85cb-d17415606a9c" status: 200 len: 1266 microversion: 2.1 time: 0.216495 May 12 14:59:00.058506 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 550/1116] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:58:59 2022] GET /compute/v2.1/servers/6f93b678-199d-4978-85cb-d17415606a9c => generated 1266 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:59:01.074625 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-a23fdd39-3a6a-41e2-931f-d57beee2087a tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:59:01.075260 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-a23fdd39-3a6a-41e2-931f-d57beee2087a tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] [instance: 6f93b678-199d-4978-85cb-d17415606a9c] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:59:01.082415 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-a23fdd39-3a6a-41e2-931f-d57beee2087a tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:59:01.082882 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-a23fdd39-3a6a-41e2-931f-d57beee2087a tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:59:01.083638 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-a23fdd39-3a6a-41e2-931f-d57beee2087a tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:59:01.084062 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-a23fdd39-3a6a-41e2-931f-d57beee2087a tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:59:01.278081 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-a23fdd39-3a6a-41e2-931f-d57beee2087a tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef8036bc3ad4725b3af2607ceb17c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235689d103ed4d0dbe7b78698395bd21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:59:01.287707 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-a23fdd39-3a6a-41e2-931f-d57beee2087a tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] 10.222.0.49 "GET /compute/v2.1/servers/6f93b678-199d-4978-85cb-d17415606a9c" status: 200 len: 1266 microversion: 2.1 time: 0.216829 May 12 14:59:01.288263 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 567/1117] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:59:01 2022] GET /compute/v2.1/servers/6f93b678-199d-4978-85cb-d17415606a9c => generated 1266 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:59:02.304595 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-cef08749-17a9-40f1-af9a-29a59c15538c tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:59:02.305208 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-cef08749-17a9-40f1-af9a-29a59c15538c tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] [instance: 6f93b678-199d-4978-85cb-d17415606a9c] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:59:02.313011 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-cef08749-17a9-40f1-af9a-29a59c15538c tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:59:02.313463 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-cef08749-17a9-40f1-af9a-29a59c15538c tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:59:02.314264 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-cef08749-17a9-40f1-af9a-29a59c15538c tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:59:02.314701 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-cef08749-17a9-40f1-af9a-29a59c15538c tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:59:02.513833 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-cef08749-17a9-40f1-af9a-29a59c15538c tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef8036bc3ad4725b3af2607ceb17c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235689d103ed4d0dbe7b78698395bd21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:59:02.522687 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-cef08749-17a9-40f1-af9a-29a59c15538c tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] 10.222.0.49 "GET /compute/v2.1/servers/6f93b678-199d-4978-85cb-d17415606a9c" status: 200 len: 1266 microversion: 2.1 time: 0.221764 May 12 14:59:02.523278 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 551/1118] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:59:02 2022] GET /compute/v2.1/servers/6f93b678-199d-4978-85cb-d17415606a9c => generated 1266 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:59:03.540056 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-f56e0e6f-2b5f-4334-8fdf-7e835be7d914 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:59:03.540699 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-f56e0e6f-2b5f-4334-8fdf-7e835be7d914 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] [instance: 6f93b678-199d-4978-85cb-d17415606a9c] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:59:03.548054 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-f56e0e6f-2b5f-4334-8fdf-7e835be7d914 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:59:03.548504 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-f56e0e6f-2b5f-4334-8fdf-7e835be7d914 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:59:03.549270 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-f56e0e6f-2b5f-4334-8fdf-7e835be7d914 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:59:03.549706 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-f56e0e6f-2b5f-4334-8fdf-7e835be7d914 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:59:03.769277 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-f56e0e6f-2b5f-4334-8fdf-7e835be7d914 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef8036bc3ad4725b3af2607ceb17c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235689d103ed4d0dbe7b78698395bd21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:59:03.777398 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-f56e0e6f-2b5f-4334-8fdf-7e835be7d914 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] 10.222.0.49 "GET /compute/v2.1/servers/6f93b678-199d-4978-85cb-d17415606a9c" status: 200 len: 1266 microversion: 2.1 time: 0.241336 May 12 14:59:03.777947 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 568/1119] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:59:03 2022] GET /compute/v2.1/servers/6f93b678-199d-4978-85cb-d17415606a9c => generated 1266 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:59:04.026298 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [req-65e25700-366a-4316-a4b1-b291e66f7d19 req-0bb127e1-f331-4bb7-a7f2-782be059488f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f93b678-199d-4978-85cb-d17415606a9c", "name": "network-vif-plugged", "status": "completed", "tag": "721835f5-5e78-4b9c-9bf4-202021da902a"}]} {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:59:04.026298 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:59:04.026298 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: warnings.warn(msg) May 12 14:59:04.031263 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [req-65e25700-366a-4316-a4b1-b291e66f7d19 req-0bb127e1-f331-4bb7-a7f2-782be059488f service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:59:04.031709 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [req-65e25700-366a-4316-a4b1-b291e66f7d19 req-0bb127e1-f331-4bb7-a7f2-782be059488f service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:59:04.052438 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.compute.server_external_events [req-65e25700-366a-4316-a4b1-b291e66f7d19 req-0bb127e1-f331-4bb7-a7f2-782be059488f service nova] Creating event network-vif-plugged:721835f5-5e78-4b9c-9bf4-202021da902a for instance 6f93b678-199d-4978-85cb-d17415606a9c on hv-cinder-83118 May 12 14:59:04.059668 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [req-65e25700-366a-4316-a4b1-b291e66f7d19 req-0bb127e1-f331-4bb7-a7f2-782be059488f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094984 May 12 14:59:04.059668 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 552/1120] 10.222.0.49 () {64 vars in 1317 bytes} [Thu May 12 14:59:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:59:04.794775 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-4cdcd9f8-b57c-44a9-8c03-5e4d7261ef27 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:59:04.795531 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-4cdcd9f8-b57c-44a9-8c03-5e4d7261ef27 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] [instance: 6f93b678-199d-4978-85cb-d17415606a9c] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:59:04.802704 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-4cdcd9f8-b57c-44a9-8c03-5e4d7261ef27 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:59:04.803188 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-4cdcd9f8-b57c-44a9-8c03-5e4d7261ef27 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:59:04.803956 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-4cdcd9f8-b57c-44a9-8c03-5e4d7261ef27 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:59:04.804398 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-4cdcd9f8-b57c-44a9-8c03-5e4d7261ef27 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:59:04.994554 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-4cdcd9f8-b57c-44a9-8c03-5e4d7261ef27 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef8036bc3ad4725b3af2607ceb17c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235689d103ed4d0dbe7b78698395bd21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:59:05.002693 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-4cdcd9f8-b57c-44a9-8c03-5e4d7261ef27 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] 10.222.0.49 "GET /compute/v2.1/servers/6f93b678-199d-4978-85cb-d17415606a9c" status: 200 len: 1266 microversion: 2.1 time: 0.211677 May 12 14:59:05.003285 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 569/1121] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:59:04 2022] GET /compute/v2.1/servers/6f93b678-199d-4978-85cb-d17415606a9c => generated 1266 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:59:06.020052 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-04b47057-3d45-4733-ab42-3a3276165e4e tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:59:06.020778 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-04b47057-3d45-4733-ab42-3a3276165e4e tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] [instance: 6f93b678-199d-4978-85cb-d17415606a9c] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:59:06.028387 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-04b47057-3d45-4733-ab42-3a3276165e4e tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:59:06.028859 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-04b47057-3d45-4733-ab42-3a3276165e4e tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:59:06.029628 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-04b47057-3d45-4733-ab42-3a3276165e4e tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:59:06.030069 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-04b47057-3d45-4733-ab42-3a3276165e4e tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:59:06.222746 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-04b47057-3d45-4733-ab42-3a3276165e4e tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef8036bc3ad4725b3af2607ceb17c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235689d103ed4d0dbe7b78698395bd21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:59:06.231176 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-04b47057-3d45-4733-ab42-3a3276165e4e tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] 10.222.0.49 "GET /compute/v2.1/servers/6f93b678-199d-4978-85cb-d17415606a9c" status: 200 len: 1453 microversion: 2.1 time: 0.215333 May 12 14:59:06.231744 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 553/1122] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:59:06 2022] GET /compute/v2.1/servers/6f93b678-199d-4978-85cb-d17415606a9c => generated 1453 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:59:06.247844 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-4c49a401-f905-4803-aee1-07dc3e3b2130 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:59:06.248458 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-4c49a401-f905-4803-aee1-07dc3e3b2130 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] [instance: 6f93b678-199d-4978-85cb-d17415606a9c] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:59:06.255698 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-4c49a401-f905-4803-aee1-07dc3e3b2130 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:59:06.256143 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-4c49a401-f905-4803-aee1-07dc3e3b2130 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:59:06.256928 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-4c49a401-f905-4803-aee1-07dc3e3b2130 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:59:06.257349 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-4c49a401-f905-4803-aee1-07dc3e3b2130 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:59:06.510314 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-4c49a401-f905-4803-aee1-07dc3e3b2130 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef8036bc3ad4725b3af2607ceb17c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235689d103ed4d0dbe7b78698395bd21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:59:06.517778 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-4c49a401-f905-4803-aee1-07dc3e3b2130 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] 10.222.0.49 "GET /compute/v2.1/servers/6f93b678-199d-4978-85cb-d17415606a9c" status: 200 len: 1453 microversion: 2.1 time: 0.273648 May 12 14:59:06.518345 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 570/1123] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:59:06 2022] GET /compute/v2.1/servers/6f93b678-199d-4978-85cb-d17415606a9c => generated 1453 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:59:09.382100 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [req-b6b73f9d-9129-4844-ae9a-80fe33c30fa7 req-014451c7-198c-4a70-aabf-f7c0f62d7a7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f93b678-199d-4978-85cb-d17415606a9c", "tag": "721835f5-5e78-4b9c-9bf4-202021da902a"}]} {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:59:09.383681 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:59:09.383681 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: warnings.warn(msg) May 12 14:59:09.392570 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [req-b6b73f9d-9129-4844-ae9a-80fe33c30fa7 req-014451c7-198c-4a70-aabf-f7c0f62d7a7f service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:59:09.393020 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [req-b6b73f9d-9129-4844-ae9a-80fe33c30fa7 req-014451c7-198c-4a70-aabf-f7c0f62d7a7f service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:59:09.415211 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.compute.server_external_events [req-b6b73f9d-9129-4844-ae9a-80fe33c30fa7 req-014451c7-198c-4a70-aabf-f7c0f62d7a7f service nova] Creating event network-changed:721835f5-5e78-4b9c-9bf4-202021da902a for instance 6f93b678-199d-4978-85cb-d17415606a9c on hv-cinder-83118 May 12 14:59:09.420370 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [req-b6b73f9d-9129-4844-ae9a-80fe33c30fa7 req-014451c7-198c-4a70-aabf-f7c0f62d7a7f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092149 May 12 14:59:09.420983 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 554/1124] 10.222.0.49 () {64 vars in 1317 bytes} [Thu May 12 14:59:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 14:59:25.454997 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-eae54ec0-c369-496a-ae19-d05434ed2aca tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-498629726"}} {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:59:25.455589 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-eae54ec0-c369-496a-ae19-d05434ed2aca tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] [instance: 2f388082-f6b9-49f0-a128-567d86ccc1ab] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:59:25.463126 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-eae54ec0-c369-496a-ae19-d05434ed2aca tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:59:25.469426 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-eae54ec0-c369-496a-ae19-d05434ed2aca tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:59:25.469426 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-eae54ec0-c369-496a-ae19-d05434ed2aca tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:59:25.469426 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-eae54ec0-c369-496a-ae19-d05434ed2aca tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:59:25.683830 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.network.security_group_api [None req-eae54ec0-c369-496a-ae19-d05434ed2aca tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Removing security group bea1f663-c0df-4d45-be41-465b9c3e4561 from port e7bdf342-ab8a-4f0c-bc6c-68dc21b7079e May 12 14:59:26.331151 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-eae54ec0-c369-496a-ae19-d05434ed2aca tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] 10.222.0.49 "POST /compute/v2.1/servers/2f388082-f6b9-49f0-a128-567d86ccc1ab/action" status: 202 len: 0 microversion: 2.1 time: 0.880240 May 12 14:59:26.333663 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 571/1125] 10.222.0.49 () {60 vars in 1277 bytes} [Thu May 12 14:59:25 2022] POST /compute/v2.1/servers/2f388082-f6b9-49f0-a128-567d86ccc1ab/action => generated 0 bytes in 882 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 14:59:26.345501 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [req-5f337311-60e5-4762-9285-c50f05c1ea06 req-cf02b652-58be-4fa1-a066-1be6e08e771d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f388082-f6b9-49f0-a128-567d86ccc1ab", "tag": "e7bdf342-ab8a-4f0c-bc6c-68dc21b7079e"}]} {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:59:26.347568 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:59:26.347568 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: warnings.warn(msg) May 12 14:59:26.361339 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [req-5f337311-60e5-4762-9285-c50f05c1ea06 req-cf02b652-58be-4fa1-a066-1be6e08e771d service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:59:26.362098 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [req-5f337311-60e5-4762-9285-c50f05c1ea06 req-cf02b652-58be-4fa1-a066-1be6e08e771d service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:59:26.391649 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.compute.server_external_events [req-5f337311-60e5-4762-9285-c50f05c1ea06 req-cf02b652-58be-4fa1-a066-1be6e08e771d service nova] Creating event network-changed:e7bdf342-ab8a-4f0c-bc6c-68dc21b7079e for instance 2f388082-f6b9-49f0-a128-567d86ccc1ab on hv-cinder-83118 May 12 14:59:26.397705 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [req-5f337311-60e5-4762-9285-c50f05c1ea06 req-cf02b652-58be-4fa1-a066-1be6e08e771d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059619 May 12 14:59:26.401868 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 555/1126] 10.222.0.49 () {64 vars in 1317 bytes} [Thu May 12 14:59:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:59:28.399192 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-f7fd041d-3c87-4d2b-810a-7941f9cd6ea5 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:59:28.399742 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-f7fd041d-3c87-4d2b-810a-7941f9cd6ea5 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] [instance: 2f388082-f6b9-49f0-a128-567d86ccc1ab] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:59:28.401853 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [req-16db04a9-9eb1-4974-a99f-7b2b47a5af6c req-75bb02e6-b0bf-4d58-b835-8ed8c0cce259 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f388082-f6b9-49f0-a128-567d86ccc1ab", "tag": "e7bdf342-ab8a-4f0c-bc6c-68dc21b7079e"}]} {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:59:28.403479 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:59:28.403479 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: warnings.warn(msg) May 12 14:59:28.410066 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-f7fd041d-3c87-4d2b-810a-7941f9cd6ea5 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:59:28.410512 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-f7fd041d-3c87-4d2b-810a-7941f9cd6ea5 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:59:28.411322 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-f7fd041d-3c87-4d2b-810a-7941f9cd6ea5 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:59:28.411751 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-f7fd041d-3c87-4d2b-810a-7941f9cd6ea5 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:59:28.413373 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [req-16db04a9-9eb1-4974-a99f-7b2b47a5af6c req-75bb02e6-b0bf-4d58-b835-8ed8c0cce259 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:59:28.413921 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [req-16db04a9-9eb1-4974-a99f-7b2b47a5af6c req-75bb02e6-b0bf-4d58-b835-8ed8c0cce259 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:59:28.432421 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.compute.server_external_events [req-16db04a9-9eb1-4974-a99f-7b2b47a5af6c req-75bb02e6-b0bf-4d58-b835-8ed8c0cce259 service nova] Creating event network-changed:e7bdf342-ab8a-4f0c-bc6c-68dc21b7079e for instance 2f388082-f6b9-49f0-a128-567d86ccc1ab on hv-cinder-83118 May 12 14:59:28.437379 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [req-16db04a9-9eb1-4974-a99f-7b2b47a5af6c req-75bb02e6-b0bf-4d58-b835-8ed8c0cce259 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039846 May 12 14:59:28.438252 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 556/1127] 10.222.0.49 () {64 vars in 1317 bytes} [Thu May 12 14:59:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:59:28.568817 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.objects.instance [None req-f7fd041d-3c87-4d2b-810a-7941f9cd6ea5 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lazy-loading 'services' on Instance uuid 2f388082-f6b9-49f0-a128-567d86ccc1ab {{(pid=102213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 12 14:59:28.895069 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-f7fd041d-3c87-4d2b-810a-7941f9cd6ea5 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] 10.222.0.49 "DELETE /compute/v2.1/servers/2f388082-f6b9-49f0-a128-567d86ccc1ab/os-volume_attachments/db1a2175-e623-4786-885d-d4bc1af80bfb" status: 202 len: 0 microversion: 2.1 time: 0.499725 May 12 14:59:28.896076 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 572/1128] 10.222.0.49 () {58 vars in 1415 bytes} [Thu May 12 14:59:28 2022] DELETE /compute/v2.1/servers/2f388082-f6b9-49f0-a128-567d86ccc1ab/os-volume_attachments/db1a2175-e623-4786-885d-d4bc1af80bfb => generated 0 bytes in 502 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 14:59:28.906629 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-542b8296-ec8c-4c6e-b348-0c55cd232053 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:59:28.908433 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-542b8296-ec8c-4c6e-b348-0c55cd232053 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] [instance: 2f388082-f6b9-49f0-a128-567d86ccc1ab] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:59:28.918307 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-542b8296-ec8c-4c6e-b348-0c55cd232053 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:59:28.918973 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-542b8296-ec8c-4c6e-b348-0c55cd232053 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:59:28.920023 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-542b8296-ec8c-4c6e-b348-0c55cd232053 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:59:28.920564 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-542b8296-ec8c-4c6e-b348-0c55cd232053 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:59:28.987227 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-542b8296-ec8c-4c6e-b348-0c55cd232053 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] 10.222.0.49 "GET /compute/v2.1/servers/2f388082-f6b9-49f0-a128-567d86ccc1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086225 May 12 14:59:28.993150 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 557/1129] 10.222.0.49 () {58 vars in 1301 bytes} [Thu May 12 14:59:28 2022] GET /compute/v2.1/servers/2f388082-f6b9-49f0-a128-567d86ccc1ab/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:59:29.999797 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-465d48ba-cd6a-4ead-853c-8dda393bf9fa tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:59:30.000773 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-465d48ba-cd6a-4ead-853c-8dda393bf9fa tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] [instance: 2f388082-f6b9-49f0-a128-567d86ccc1ab] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:59:30.008211 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-465d48ba-cd6a-4ead-853c-8dda393bf9fa tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:59:30.008654 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-465d48ba-cd6a-4ead-853c-8dda393bf9fa tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:59:30.014759 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-465d48ba-cd6a-4ead-853c-8dda393bf9fa tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:59:30.014759 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-465d48ba-cd6a-4ead-853c-8dda393bf9fa tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:59:30.081401 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-465d48ba-cd6a-4ead-853c-8dda393bf9fa tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] 10.222.0.49 "GET /compute/v2.1/servers/2f388082-f6b9-49f0-a128-567d86ccc1ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084809 May 12 14:59:30.083429 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 573/1130] 10.222.0.49 () {58 vars in 1301 bytes} [Thu May 12 14:59:29 2022] GET /compute/v2.1/servers/2f388082-f6b9-49f0-a128-567d86ccc1ab/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:59:31.095263 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-c054e3ae-915c-477c-ad33-b5df5bb1e84b tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:59:31.096188 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-c054e3ae-915c-477c-ad33-b5df5bb1e84b tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] [instance: 2f388082-f6b9-49f0-a128-567d86ccc1ab] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:59:31.103558 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-c054e3ae-915c-477c-ad33-b5df5bb1e84b tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:59:31.104012 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-c054e3ae-915c-477c-ad33-b5df5bb1e84b tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:59:31.104783 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-c054e3ae-915c-477c-ad33-b5df5bb1e84b tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:59:31.105217 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-c054e3ae-915c-477c-ad33-b5df5bb1e84b tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:59:31.167798 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-c054e3ae-915c-477c-ad33-b5df5bb1e84b tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] 10.222.0.49 "GET /compute/v2.1/servers/2f388082-f6b9-49f0-a128-567d86ccc1ab/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.076312 May 12 14:59:31.168350 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 558/1131] 10.222.0.49 () {58 vars in 1301 bytes} [Thu May 12 14:59:31 2022] GET /compute/v2.1/servers/2f388082-f6b9-49f0-a128-567d86ccc1ab/os-volume_attachments => generated 25 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 12 14:59:31.178753 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-05652bb8-bb3c-4deb-af66-2def191efcf7 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:59:31.179294 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-05652bb8-bb3c-4deb-af66-2def191efcf7 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] [instance: 2f388082-f6b9-49f0-a128-567d86ccc1ab] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:59:31.186585 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-05652bb8-bb3c-4deb-af66-2def191efcf7 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:59:31.187068 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-05652bb8-bb3c-4deb-af66-2def191efcf7 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:59:31.188402 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-05652bb8-bb3c-4deb-af66-2def191efcf7 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:59:31.188835 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-05652bb8-bb3c-4deb-af66-2def191efcf7 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:59:31.331015 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.wsgi [None req-05652bb8-bb3c-4deb-af66-2def191efcf7 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] HTTP exception thrown: Instance 2f388082-f6b9-49f0-a128-567d86ccc1ab is not attached to volume db1a2175-e623-4786-885d-d4bc1af80bfb May 12 14:59:31.331633 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-05652bb8-bb3c-4deb-af66-2def191efcf7 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Returning 404 to user: Instance 2f388082-f6b9-49f0-a128-567d86ccc1ab is not attached to volume db1a2175-e623-4786-885d-d4bc1af80bfb {{(pid=102213) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 12 14:59:31.332465 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-05652bb8-bb3c-4deb-af66-2def191efcf7 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] 10.222.0.49 "DELETE /compute/v2.1/servers/2f388082-f6b9-49f0-a128-567d86ccc1ab/os-volume_attachments/db1a2175-e623-4786-885d-d4bc1af80bfb" status: 404 len: 154 microversion: 2.1 time: 0.157584 May 12 14:59:31.333016 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 574/1132] 10.222.0.49 () {58 vars in 1415 bytes} [Thu May 12 14:59:31 2022] DELETE /compute/v2.1/servers/2f388082-f6b9-49f0-a128-567d86ccc1ab/os-volume_attachments/db1a2175-e623-4786-885d-d4bc1af80bfb => generated 154 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 14:59:32.784935 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-aa33edb5-b849-4fb8-bb9c-5e26aeb2dd9e tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:59:32.785445 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-aa33edb5-b849-4fb8-bb9c-5e26aeb2dd9e tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] [instance: 2f388082-f6b9-49f0-a128-567d86ccc1ab] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:59:32.792929 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-aa33edb5-b849-4fb8-bb9c-5e26aeb2dd9e tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:59:32.793382 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-aa33edb5-b849-4fb8-bb9c-5e26aeb2dd9e tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:59:32.794149 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-aa33edb5-b849-4fb8-bb9c-5e26aeb2dd9e tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:59:32.794589 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-aa33edb5-b849-4fb8-bb9c-5e26aeb2dd9e tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:59:32.855228 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-aa33edb5-b849-4fb8-bb9c-5e26aeb2dd9e tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] [instance: 2f388082-f6b9-49f0-a128-567d86ccc1ab] Going to try to terminate instance {{(pid=102212) delete /opt/stack/nova/nova/compute/api.py:2562}} May 12 14:59:33.260535 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-aa33edb5-b849-4fb8-bb9c-5e26aeb2dd9e tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] 10.222.0.49 "DELETE /compute/v2.1/servers/2f388082-f6b9-49f0-a128-567d86ccc1ab" status: 204 len: 0 microversion: 2.1 time: 0.479537 May 12 14:59:33.261112 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 559/1133] 10.222.0.49 () {58 vars in 1238 bytes} [Thu May 12 14:59:32 2022] DELETE /compute/v2.1/servers/2f388082-f6b9-49f0-a128-567d86ccc1ab => generated 0 bytes in 481 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 14:59:33.269536 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-e6b5e590-9edb-4d90-9abe-0081b2e255de tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:59:33.270143 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-e6b5e590-9edb-4d90-9abe-0081b2e255de tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] [instance: 2f388082-f6b9-49f0-a128-567d86ccc1ab] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:59:33.277394 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e6b5e590-9edb-4d90-9abe-0081b2e255de tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:59:33.277832 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e6b5e590-9edb-4d90-9abe-0081b2e255de tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:59:33.278588 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e6b5e590-9edb-4d90-9abe-0081b2e255de tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:59:33.279046 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-e6b5e590-9edb-4d90-9abe-0081b2e255de tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:59:33.550444 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-e6b5e590-9edb-4d90-9abe-0081b2e255de tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9121971fd3434af6a03ecaaa3ad904f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf186ac47354ce3ac7681a633be4c2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:59:33.558658 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-e6b5e590-9edb-4d90-9abe-0081b2e255de tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] 10.222.0.49 "GET /compute/v2.1/servers/2f388082-f6b9-49f0-a128-567d86ccc1ab" status: 200 len: 1556 microversion: 2.1 time: 0.293302 May 12 14:59:33.559254 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 575/1134] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:59:33 2022] GET /compute/v2.1/servers/2f388082-f6b9-49f0-a128-567d86ccc1ab => generated 1556 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:59:34.576385 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-44b3618a-aa7d-437e-b6a0-91513ac93aad tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:59:34.577071 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-44b3618a-aa7d-437e-b6a0-91513ac93aad tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] [instance: 2f388082-f6b9-49f0-a128-567d86ccc1ab] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:59:34.584896 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-44b3618a-aa7d-437e-b6a0-91513ac93aad tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:59:34.585347 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-44b3618a-aa7d-437e-b6a0-91513ac93aad tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:59:34.586122 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-44b3618a-aa7d-437e-b6a0-91513ac93aad tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:59:34.586558 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-44b3618a-aa7d-437e-b6a0-91513ac93aad tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:59:35.131438 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-44b3618a-aa7d-437e-b6a0-91513ac93aad tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9121971fd3434af6a03ecaaa3ad904f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf186ac47354ce3ac7681a633be4c2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:59:35.139642 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-44b3618a-aa7d-437e-b6a0-91513ac93aad tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] 10.222.0.49 "GET /compute/v2.1/servers/2f388082-f6b9-49f0-a128-567d86ccc1ab" status: 200 len: 1556 microversion: 2.1 time: 0.567454 May 12 14:59:35.143171 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 560/1135] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:59:34 2022] GET /compute/v2.1/servers/2f388082-f6b9-49f0-a128-567d86ccc1ab => generated 1556 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:59:36.021855 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [req-53f6ed79-2b19-45a9-a32f-ec5231bb3f4f req-24e3e5cc-06b3-4db9-bad2-56a57eefa229 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f388082-f6b9-49f0-a128-567d86ccc1ab", "name": "network-vif-deleted", "tag": "e7bdf342-ab8a-4f0c-bc6c-68dc21b7079e"}]} {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 14:59:36.023409 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 14:59:36.023409 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: warnings.warn(msg) May 12 14:59:36.032235 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [req-53f6ed79-2b19-45a9-a32f-ec5231bb3f4f req-24e3e5cc-06b3-4db9-bad2-56a57eefa229 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:59:36.038026 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [req-53f6ed79-2b19-45a9-a32f-ec5231bb3f4f req-24e3e5cc-06b3-4db9-bad2-56a57eefa229 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:59:36.048622 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.compute.server_external_events [req-53f6ed79-2b19-45a9-a32f-ec5231bb3f4f req-24e3e5cc-06b3-4db9-bad2-56a57eefa229 service nova] Creating event network-vif-deleted:e7bdf342-ab8a-4f0c-bc6c-68dc21b7079e for instance 2f388082-f6b9-49f0-a128-567d86ccc1ab on hv-cinder-83118 May 12 14:59:36.053500 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [req-53f6ed79-2b19-45a9-a32f-ec5231bb3f4f req-24e3e5cc-06b3-4db9-bad2-56a57eefa229 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035311 May 12 14:59:36.054036 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 576/1136] 10.222.0.49 () {64 vars in 1317 bytes} [Thu May 12 14:59:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 14:59:36.157329 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-106e1a8d-cc9f-4c16-a284-ee7ab819fd30 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:59:36.158538 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-106e1a8d-cc9f-4c16-a284-ee7ab819fd30 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] [instance: 2f388082-f6b9-49f0-a128-567d86ccc1ab] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:59:36.167986 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-106e1a8d-cc9f-4c16-a284-ee7ab819fd30 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:59:36.170148 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-106e1a8d-cc9f-4c16-a284-ee7ab819fd30 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:59:36.170148 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-106e1a8d-cc9f-4c16-a284-ee7ab819fd30 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:59:36.170148 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-106e1a8d-cc9f-4c16-a284-ee7ab819fd30 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:59:36.283155 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-106e1a8d-cc9f-4c16-a284-ee7ab819fd30 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9121971fd3434af6a03ecaaa3ad904f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cf186ac47354ce3ac7681a633be4c2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 14:59:36.291770 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-106e1a8d-cc9f-4c16-a284-ee7ab819fd30 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] 10.222.0.49 "GET /compute/v2.1/servers/2f388082-f6b9-49f0-a128-567d86ccc1ab" status: 200 len: 1344 microversion: 2.1 time: 0.138877 May 12 14:59:36.292352 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 561/1137] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:59:36 2022] GET /compute/v2.1/servers/2f388082-f6b9-49f0-a128-567d86ccc1ab => generated 1344 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 14:59:37.309974 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-ba9ea0a7-87f2-4fdc-a585-8a7cc394d3b9 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:59:37.310676 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-ba9ea0a7-87f2-4fdc-a585-8a7cc394d3b9 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] [instance: 2f388082-f6b9-49f0-a128-567d86ccc1ab] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 14:59:37.318775 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-ba9ea0a7-87f2-4fdc-a585-8a7cc394d3b9 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:59:37.319256 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-ba9ea0a7-87f2-4fdc-a585-8a7cc394d3b9 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:59:37.320053 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-ba9ea0a7-87f2-4fdc-a585-8a7cc394d3b9 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 14:59:37.320489 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-ba9ea0a7-87f2-4fdc-a585-8a7cc394d3b9 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 14:59:37.375943 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.wsgi [None req-ba9ea0a7-87f2-4fdc-a585-8a7cc394d3b9 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] HTTP exception thrown: Instance 2f388082-f6b9-49f0-a128-567d86ccc1ab could not be found. May 12 14:59:37.376974 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-ba9ea0a7-87f2-4fdc-a585-8a7cc394d3b9 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Returning 404 to user: Instance 2f388082-f6b9-49f0-a128-567d86ccc1ab could not be found. {{(pid=102213) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 12 14:59:37.378341 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-ba9ea0a7-87f2-4fdc-a585-8a7cc394d3b9 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] 10.222.0.49 "GET /compute/v2.1/servers/2f388082-f6b9-49f0-a128-567d86ccc1ab" status: 404 len: 111 microversion: 2.1 time: 0.072358 May 12 14:59:37.379179 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 577/1138] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 14:59:37 2022] GET /compute/v2.1/servers/2f388082-f6b9-49f0-a128-567d86ccc1ab => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 14:59:37.388095 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-1cb687eb-bd73-4b67-afa0-345a5c13a0b7 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] Calling method '.version_select at 0x7ff77e549160>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 14:59:37.393056 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: ERROR oslo.messaging._drivers.impl_rabbit [None req-1cb687eb-bd73-4b67-afa0-345a5c13a0b7 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] [e32c6395-af61-4ee9-aa42-dc34b58c9b4e] AMQP server on 10.222.0.49:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 12 14:59:38.400634 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO oslo.messaging._drivers.impl_rabbit [None req-1cb687eb-bd73-4b67-afa0-345a5c13a0b7 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] [e32c6395-af61-4ee9-aa42-dc34b58c9b4e] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 44260. May 12 14:59:38.472320 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-1cb687eb-bd73-4b67-afa0-345a5c13a0b7 tempest-TestMinimumBasicScenario-325500149 tempest-TestMinimumBasicScenario-325500149-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2074245891" status: 202 len: 0 microversion: 2.1 time: 1.088743 May 12 14:59:38.472921 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 562/1139] 10.222.0.49 () {58 vars in 1271 bytes} [Thu May 12 14:59:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2074245891 => generated 0 bytes in 1090 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 15:00:00.586365 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 15:00:00.587026 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: Thu May 12 15:00:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 15:00:39.391862 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: ERROR oslo.messaging._drivers.impl_rabbit [-] [289d8c0f-ae00-419e-9b8f-c41fa206b48c] AMQP server on 10.222.0.49:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 12 15:00:39.392435 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-0e7e1782-edba-4b23-9ed9-3fd483b8342b tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:00:39.392806 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-0e7e1782-edba-4b23-9ed9-3fd483b8342b tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] [instance: 6f93b678-199d-4978-85cb-d17415606a9c] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 15:00:39.395663 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [req-b7e6861b-bf49-4b3a-bb4e-9f0a26b45438 req-2b4a1f23-2556-4ff3-8221-5b19d28e573f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f93b678-199d-4978-85cb-d17415606a9c", "tag": "721835f5-5e78-4b9c-9bf4-202021da902a"}]} {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:00:39.397390 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 15:00:39.397390 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: warnings.warn(msg) May 12 15:00:39.400276 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-0e7e1782-edba-4b23-9ed9-3fd483b8342b tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 15:00:39.401002 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-0e7e1782-edba-4b23-9ed9-3fd483b8342b tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 15:00:39.401918 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-0e7e1782-edba-4b23-9ed9-3fd483b8342b tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 15:00:39.402239 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-0e7e1782-edba-4b23-9ed9-3fd483b8342b tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 15:00:39.406821 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [req-b7e6861b-bf49-4b3a-bb4e-9f0a26b45438 req-2b4a1f23-2556-4ff3-8221-5b19d28e573f service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 15:00:39.407333 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [req-b7e6861b-bf49-4b3a-bb4e-9f0a26b45438 req-2b4a1f23-2556-4ff3-8221-5b19d28e573f service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 15:00:39.423814 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.compute.server_external_events [req-b7e6861b-bf49-4b3a-bb4e-9f0a26b45438 req-2b4a1f23-2556-4ff3-8221-5b19d28e573f service nova] Creating event network-changed:721835f5-5e78-4b9c-9bf4-202021da902a for instance 6f93b678-199d-4978-85cb-d17415606a9c on hv-cinder-83118 May 12 15:00:39.428830 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [req-b7e6861b-bf49-4b3a-bb4e-9f0a26b45438 req-2b4a1f23-2556-4ff3-8221-5b19d28e573f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039105 May 12 15:00:39.429658 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 563/1140] 10.222.0.49 () {64 vars in 1317 bytes} [Thu May 12 15:00:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 15:00:39.463862 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-0e7e1782-edba-4b23-9ed9-3fd483b8342b tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] [instance: 6f93b678-199d-4978-85cb-d17415606a9c] Going to try to terminate instance {{(pid=102213) delete /opt/stack/nova/nova/compute/api.py:2562}} May 12 15:00:39.848503 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-0e7e1782-edba-4b23-9ed9-3fd483b8342b tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] 10.222.0.49 "DELETE /compute/v2.1/servers/6f93b678-199d-4978-85cb-d17415606a9c" status: 204 len: 0 microversion: 2.1 time: 0.460366 May 12 15:00:39.849674 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 578/1141] 10.222.0.49 () {58 vars in 1238 bytes} [Thu May 12 15:00:39 2022] DELETE /compute/v2.1/servers/6f93b678-199d-4978-85cb-d17415606a9c => generated 0 bytes in 463 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 15:00:39.860709 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-ace29132-564b-49fc-ab44-8685940267f4 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:00:39.861511 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-ace29132-564b-49fc-ab44-8685940267f4 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] [instance: 6f93b678-199d-4978-85cb-d17415606a9c] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 15:00:39.869447 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-ace29132-564b-49fc-ab44-8685940267f4 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 15:00:39.869991 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-ace29132-564b-49fc-ab44-8685940267f4 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 15:00:39.870875 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-ace29132-564b-49fc-ab44-8685940267f4 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 15:00:39.871403 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-ace29132-564b-49fc-ab44-8685940267f4 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 15:00:40.152142 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-ace29132-564b-49fc-ab44-8685940267f4 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef8036bc3ad4725b3af2607ceb17c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235689d103ed4d0dbe7b78698395bd21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:00:40.161310 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-ace29132-564b-49fc-ab44-8685940267f4 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] 10.222.0.49 "GET /compute/v2.1/servers/6f93b678-199d-4978-85cb-d17415606a9c" status: 200 len: 1577 microversion: 2.1 time: 0.306496 May 12 15:00:40.162178 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 564/1142] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 15:00:39 2022] GET /compute/v2.1/servers/6f93b678-199d-4978-85cb-d17415606a9c => generated 1577 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:00:41.180200 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-1494204b-a278-44b7-befa-f1d16d6c5cf3 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:00:41.181032 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-1494204b-a278-44b7-befa-f1d16d6c5cf3 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] [instance: 6f93b678-199d-4978-85cb-d17415606a9c] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 15:00:41.189026 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-1494204b-a278-44b7-befa-f1d16d6c5cf3 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 15:00:41.189473 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-1494204b-a278-44b7-befa-f1d16d6c5cf3 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 15:00:41.190232 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-1494204b-a278-44b7-befa-f1d16d6c5cf3 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 15:00:41.190665 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-1494204b-a278-44b7-befa-f1d16d6c5cf3 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 15:00:41.385144 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-1494204b-a278-44b7-befa-f1d16d6c5cf3 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef8036bc3ad4725b3af2607ceb17c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235689d103ed4d0dbe7b78698395bd21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:00:41.393883 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-1494204b-a278-44b7-befa-f1d16d6c5cf3 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] 10.222.0.49 "GET /compute/v2.1/servers/6f93b678-199d-4978-85cb-d17415606a9c" status: 200 len: 1459 microversion: 2.1 time: 0.217851 May 12 15:00:41.394445 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 579/1143] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 15:00:41 2022] GET /compute/v2.1/servers/6f93b678-199d-4978-85cb-d17415606a9c => generated 1459 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:00:42.413212 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-bba2e7a6-f69e-4951-8af8-579041c56272 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:00:42.413822 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-bba2e7a6-f69e-4951-8af8-579041c56272 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] [instance: 6f93b678-199d-4978-85cb-d17415606a9c] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 15:00:42.423518 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-bba2e7a6-f69e-4951-8af8-579041c56272 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 15:00:42.423966 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-bba2e7a6-f69e-4951-8af8-579041c56272 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 15:00:42.424738 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-bba2e7a6-f69e-4951-8af8-579041c56272 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 15:00:42.425166 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-bba2e7a6-f69e-4951-8af8-579041c56272 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 15:00:42.458836 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO oslo.messaging._drivers.impl_rabbit [-] [289d8c0f-ae00-419e-9b8f-c41fa206b48c] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 44390. May 12 15:00:42.504295 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [req-e26994db-dcbe-4d07-ac4f-07600c150abb req-c56bef1f-6405-4ea5-9497-f0cd6072e02c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f93b678-199d-4978-85cb-d17415606a9c", "name": "network-vif-deleted", "tag": "721835f5-5e78-4b9c-9bf4-202021da902a"}]} {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:00:42.505840 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 15:00:42.505840 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: warnings.warn(msg) May 12 15:00:42.513845 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [req-e26994db-dcbe-4d07-ac4f-07600c150abb req-c56bef1f-6405-4ea5-9497-f0cd6072e02c service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 15:00:42.518951 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [req-e26994db-dcbe-4d07-ac4f-07600c150abb req-c56bef1f-6405-4ea5-9497-f0cd6072e02c service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 15:00:42.532943 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.compute.server_external_events [req-e26994db-dcbe-4d07-ac4f-07600c150abb req-c56bef1f-6405-4ea5-9497-f0cd6072e02c service nova] Creating event network-vif-deleted:721835f5-5e78-4b9c-9bf4-202021da902a for instance 6f93b678-199d-4978-85cb-d17415606a9c on hv-cinder-83118 May 12 15:00:42.538062 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [req-e26994db-dcbe-4d07-ac4f-07600c150abb req-c56bef1f-6405-4ea5-9497-f0cd6072e02c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037115 May 12 15:00:42.538645 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 580/1144] 10.222.0.49 () {64 vars in 1317 bytes} [Thu May 12 15:00:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 12 15:00:42.539095 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-bba2e7a6-f69e-4951-8af8-579041c56272 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef8036bc3ad4725b3af2607ceb17c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235689d103ed4d0dbe7b78698395bd21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:00:42.548512 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-bba2e7a6-f69e-4951-8af8-579041c56272 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] 10.222.0.49 "GET /compute/v2.1/servers/6f93b678-199d-4978-85cb-d17415606a9c" status: 200 len: 1391 microversion: 2.1 time: 0.139420 May 12 15:00:42.549237 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 565/1145] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 15:00:42 2022] GET /compute/v2.1/servers/6f93b678-199d-4978-85cb-d17415606a9c => generated 1391 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:00:43.566554 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-c3fe4d64-2b52-472a-8680-dc0bf6a95b48 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:00:43.567286 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-c3fe4d64-2b52-472a-8680-dc0bf6a95b48 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] [instance: 6f93b678-199d-4978-85cb-d17415606a9c] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 15:00:43.574772 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-c3fe4d64-2b52-472a-8680-dc0bf6a95b48 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 15:00:43.575258 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-c3fe4d64-2b52-472a-8680-dc0bf6a95b48 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 15:00:43.576027 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-c3fe4d64-2b52-472a-8680-dc0bf6a95b48 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 15:00:43.576463 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-c3fe4d64-2b52-472a-8680-dc0bf6a95b48 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 15:00:43.644341 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-c3fe4d64-2b52-472a-8680-dc0bf6a95b48 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 15:00:43.644790 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-c3fe4d64-2b52-472a-8680-dc0bf6a95b48 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 15:00:43.645242 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.objects.instance [None req-c3fe4d64-2b52-472a-8680-dc0bf6a95b48 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lazy-loading 'fault' on Instance uuid 6f93b678-199d-4978-85cb-d17415606a9c {{(pid=102213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 12 15:00:43.799608 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-c3fe4d64-2b52-472a-8680-dc0bf6a95b48 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef8036bc3ad4725b3af2607ceb17c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235689d103ed4d0dbe7b78698395bd21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:00:43.808027 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-c3fe4d64-2b52-472a-8680-dc0bf6a95b48 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] 10.222.0.49 "GET /compute/v2.1/servers/6f93b678-199d-4978-85cb-d17415606a9c" status: 200 len: 1230 microversion: 2.1 time: 0.245799 May 12 15:00:43.808591 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 581/1146] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 15:00:43 2022] GET /compute/v2.1/servers/6f93b678-199d-4978-85cb-d17415606a9c => generated 1230 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:00:44.825202 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-6a3ef171-d8fe-4e1e-b184-c94a0283d6a6 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:00:44.825821 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-6a3ef171-d8fe-4e1e-b184-c94a0283d6a6 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] [instance: 6f93b678-199d-4978-85cb-d17415606a9c] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 15:00:44.833416 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-6a3ef171-d8fe-4e1e-b184-c94a0283d6a6 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 15:00:44.834090 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-6a3ef171-d8fe-4e1e-b184-c94a0283d6a6 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 15:00:44.834983 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-6a3ef171-d8fe-4e1e-b184-c94a0283d6a6 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 15:00:44.835471 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-6a3ef171-d8fe-4e1e-b184-c94a0283d6a6 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 15:00:44.887085 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.wsgi [None req-6a3ef171-d8fe-4e1e-b184-c94a0283d6a6 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] HTTP exception thrown: Instance 6f93b678-199d-4978-85cb-d17415606a9c could not be found. May 12 15:00:44.887695 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-6a3ef171-d8fe-4e1e-b184-c94a0283d6a6 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Returning 404 to user: Instance 6f93b678-199d-4978-85cb-d17415606a9c could not be found. {{(pid=102212) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 12 15:00:44.888538 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-6a3ef171-d8fe-4e1e-b184-c94a0283d6a6 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] 10.222.0.49 "GET /compute/v2.1/servers/6f93b678-199d-4978-85cb-d17415606a9c" status: 404 len: 111 microversion: 2.1 time: 0.067131 May 12 15:00:44.889110 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 566/1147] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 15:00:44 2022] GET /compute/v2.1/servers/6f93b678-199d-4978-85cb-d17415606a9c => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 15:00:49.291789 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-f674cc8f-17c0-46ef-83d9-00fb1fcc01f8 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:00:49.292356 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-f674cc8f-17c0-46ef-83d9-00fb1fcc01f8 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] [instance: 89809460-5d38-4898-bd05-be5952139ea4] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 15:00:49.293908 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [req-6e453d5d-947f-41c9-8595-9e5715fe3d98 req-a632cbeb-455a-4888-8ab7-b33f4a55b75b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89809460-5d38-4898-bd05-be5952139ea4", "tag": "69fbebb8-e600-4a28-85b5-b354fe5f61f1"}]} {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:00:49.295899 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 15:00:49.295899 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: warnings.warn(msg) May 12 15:00:49.300541 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-f674cc8f-17c0-46ef-83d9-00fb1fcc01f8 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 15:00:49.301064 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-f674cc8f-17c0-46ef-83d9-00fb1fcc01f8 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 15:00:49.302411 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-f674cc8f-17c0-46ef-83d9-00fb1fcc01f8 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 15:00:49.302950 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-f674cc8f-17c0-46ef-83d9-00fb1fcc01f8 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 15:00:49.304857 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [req-6e453d5d-947f-41c9-8595-9e5715fe3d98 req-a632cbeb-455a-4888-8ab7-b33f4a55b75b service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 15:00:49.305461 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [req-6e453d5d-947f-41c9-8595-9e5715fe3d98 req-a632cbeb-455a-4888-8ab7-b33f4a55b75b service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 15:00:49.321831 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.compute.server_external_events [req-6e453d5d-947f-41c9-8595-9e5715fe3d98 req-a632cbeb-455a-4888-8ab7-b33f4a55b75b service nova] Creating event network-changed:69fbebb8-e600-4a28-85b5-b354fe5f61f1 for instance 89809460-5d38-4898-bd05-be5952139ea4 on hv-cinder-83118 May 12 15:00:49.326717 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [req-6e453d5d-947f-41c9-8595-9e5715fe3d98 req-a632cbeb-455a-4888-8ab7-b33f4a55b75b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036315 May 12 15:00:49.328091 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 567/1148] 10.222.0.49 () {64 vars in 1317 bytes} [Thu May 12 15:00:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:00:49.364458 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-f674cc8f-17c0-46ef-83d9-00fb1fcc01f8 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] [instance: 89809460-5d38-4898-bd05-be5952139ea4] Going to try to terminate instance {{(pid=102213) delete /opt/stack/nova/nova/compute/api.py:2562}} May 12 15:00:49.706337 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-f674cc8f-17c0-46ef-83d9-00fb1fcc01f8 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] 10.222.0.49 "DELETE /compute/v2.1/servers/89809460-5d38-4898-bd05-be5952139ea4" status: 204 len: 0 microversion: 2.1 time: 0.418115 May 12 15:00:49.707229 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 582/1149] 10.222.0.49 () {58 vars in 1238 bytes} [Thu May 12 15:00:49 2022] DELETE /compute/v2.1/servers/89809460-5d38-4898-bd05-be5952139ea4 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 12 15:00:49.718090 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-bd5a66c8-6cab-4685-bbe7-f63788057296 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:00:49.718782 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-bd5a66c8-6cab-4685-bbe7-f63788057296 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] [instance: 89809460-5d38-4898-bd05-be5952139ea4] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 15:00:49.727276 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-bd5a66c8-6cab-4685-bbe7-f63788057296 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 15:00:49.727798 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-bd5a66c8-6cab-4685-bbe7-f63788057296 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 15:00:49.728579 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-bd5a66c8-6cab-4685-bbe7-f63788057296 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 15:00:49.729014 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-bd5a66c8-6cab-4685-bbe7-f63788057296 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 15:00:50.036173 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-bd5a66c8-6cab-4685-bbe7-f63788057296 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef8036bc3ad4725b3af2607ceb17c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235689d103ed4d0dbe7b78698395bd21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:00:50.045376 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-bd5a66c8-6cab-4685-bbe7-f63788057296 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] 10.222.0.49 "GET /compute/v2.1/servers/89809460-5d38-4898-bd05-be5952139ea4" status: 200 len: 1579 microversion: 2.1 time: 0.333378 May 12 15:00:50.046249 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 568/1150] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 15:00:49 2022] GET /compute/v2.1/servers/89809460-5d38-4898-bd05-be5952139ea4 => generated 1579 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:00:51.063941 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-dd73e494-13d9-4b7c-993b-8e1d99d53993 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:00:51.065359 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-dd73e494-13d9-4b7c-993b-8e1d99d53993 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] [instance: 89809460-5d38-4898-bd05-be5952139ea4] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 15:00:51.071825 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-dd73e494-13d9-4b7c-993b-8e1d99d53993 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 15:00:51.072270 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-dd73e494-13d9-4b7c-993b-8e1d99d53993 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 15:00:51.073035 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-dd73e494-13d9-4b7c-993b-8e1d99d53993 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 15:00:51.073469 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-dd73e494-13d9-4b7c-993b-8e1d99d53993 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 15:00:51.278566 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-dd73e494-13d9-4b7c-993b-8e1d99d53993 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef8036bc3ad4725b3af2607ceb17c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235689d103ed4d0dbe7b78698395bd21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:00:51.286984 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-dd73e494-13d9-4b7c-993b-8e1d99d53993 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] 10.222.0.49 "GET /compute/v2.1/servers/89809460-5d38-4898-bd05-be5952139ea4" status: 200 len: 1460 microversion: 2.1 time: 0.227884 May 12 15:00:51.287559 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 583/1151] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 15:00:51 2022] GET /compute/v2.1/servers/89809460-5d38-4898-bd05-be5952139ea4 => generated 1460 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:00:52.304754 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-b96a7d3d-f9cd-4d7a-ab89-96e14c3f61fb tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:00:52.305529 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-b96a7d3d-f9cd-4d7a-ab89-96e14c3f61fb tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] [instance: 89809460-5d38-4898-bd05-be5952139ea4] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 15:00:52.307958 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [req-4f59e840-c201-42a0-8643-34057e5192fb req-b5387662-8c2c-4965-b833-e54b66bfa731 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89809460-5d38-4898-bd05-be5952139ea4", "name": "network-vif-deleted", "tag": "69fbebb8-e600-4a28-85b5-b354fe5f61f1"}]} {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 12 15:00:52.310063 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1065: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 12 15:00:52.310063 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: warnings.warn(msg) May 12 15:00:52.313402 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-b96a7d3d-f9cd-4d7a-ab89-96e14c3f61fb tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 15:00:52.313852 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-b96a7d3d-f9cd-4d7a-ab89-96e14c3f61fb tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 15:00:52.314629 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-b96a7d3d-f9cd-4d7a-ab89-96e14c3f61fb tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 15:00:52.315099 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-b96a7d3d-f9cd-4d7a-ab89-96e14c3f61fb tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 15:00:52.318883 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [req-4f59e840-c201-42a0-8643-34057e5192fb req-b5387662-8c2c-4965-b833-e54b66bfa731 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 15:00:52.326025 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [req-4f59e840-c201-42a0-8643-34057e5192fb req-b5387662-8c2c-4965-b833-e54b66bfa731 service nova] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 15:00:52.334848 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.compute.server_external_events [req-4f59e840-c201-42a0-8643-34057e5192fb req-b5387662-8c2c-4965-b833-e54b66bfa731 service nova] Creating event network-vif-deleted:69fbebb8-e600-4a28-85b5-b354fe5f61f1 for instance 89809460-5d38-4898-bd05-be5952139ea4 on hv-cinder-83118 May 12 15:00:52.339727 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [req-4f59e840-c201-42a0-8643-34057e5192fb req-b5387662-8c2c-4965-b833-e54b66bfa731 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035484 May 12 15:00:52.340359 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 584/1152] 10.222.0.49 () {64 vars in 1317 bytes} [Thu May 12 15:00:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 12 15:00:52.428284 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.policy [None req-b96a7d3d-f9cd-4d7a-ab89-96e14c3f61fb tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef8036bc3ad4725b3af2607ceb17c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235689d103ed4d0dbe7b78698395bd21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102212) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:00:52.436387 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-b96a7d3d-f9cd-4d7a-ab89-96e14c3f61fb tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] 10.222.0.49 "GET /compute/v2.1/servers/89809460-5d38-4898-bd05-be5952139ea4" status: 200 len: 1392 microversion: 2.1 time: 0.135326 May 12 15:00:52.437601 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 569/1153] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 15:00:52 2022] GET /compute/v2.1/servers/89809460-5d38-4898-bd05-be5952139ea4 => generated 1392 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:00:53.455249 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-a569f9b2-4b3c-4e7d-a02b-730b7c7f00d7 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:00:53.455859 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-a569f9b2-4b3c-4e7d-a02b-730b7c7f00d7 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] [instance: 89809460-5d38-4898-bd05-be5952139ea4] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 15:00:53.463330 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-a569f9b2-4b3c-4e7d-a02b-730b7c7f00d7 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 15:00:53.463877 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-a569f9b2-4b3c-4e7d-a02b-730b7c7f00d7 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 15:00:53.464712 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-a569f9b2-4b3c-4e7d-a02b-730b7c7f00d7 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 15:00:53.465180 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-a569f9b2-4b3c-4e7d-a02b-730b7c7f00d7 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 15:00:53.536935 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-a569f9b2-4b3c-4e7d-a02b-730b7c7f00d7 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 15:00:53.537391 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-a569f9b2-4b3c-4e7d-a02b-730b7c7f00d7 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 15:00:53.537839 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.objects.instance [None req-a569f9b2-4b3c-4e7d-a02b-730b7c7f00d7 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lazy-loading 'fault' on Instance uuid 89809460-5d38-4898-bd05-be5952139ea4 {{(pid=102213) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 12 15:00:53.707548 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.policy [None req-a569f9b2-4b3c-4e7d-a02b-730b7c7f00d7 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fef8036bc3ad4725b3af2607ceb17c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '235689d103ed4d0dbe7b78698395bd21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=102213) authorize /opt/stack/nova/nova/policy.py:199}} May 12 15:00:53.716172 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-a569f9b2-4b3c-4e7d-a02b-730b7c7f00d7 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] 10.222.0.49 "GET /compute/v2.1/servers/89809460-5d38-4898-bd05-be5952139ea4" status: 200 len: 1230 microversion: 2.1 time: 0.265835 May 12 15:00:53.716741 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 585/1154] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 15:00:53 2022] GET /compute/v2.1/servers/89809460-5d38-4898-bd05-be5952139ea4 => generated 1230 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 12 15:00:54.732649 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-72434c1e-0376-48ca-a13f-621405da878b tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:00:54.733265 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-72434c1e-0376-48ca-a13f-621405da878b tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] [instance: 89809460-5d38-4898-bd05-be5952139ea4] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 15:00:54.741035 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-72434c1e-0376-48ca-a13f-621405da878b tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 15:00:54.741482 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-72434c1e-0376-48ca-a13f-621405da878b tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 15:00:54.742247 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-72434c1e-0376-48ca-a13f-621405da878b tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 15:00:54.742682 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-72434c1e-0376-48ca-a13f-621405da878b tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 15:00:54.791583 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.wsgi [None req-72434c1e-0376-48ca-a13f-621405da878b tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] HTTP exception thrown: Instance 89809460-5d38-4898-bd05-be5952139ea4 could not be found. May 12 15:00:54.792171 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-72434c1e-0376-48ca-a13f-621405da878b tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Returning 404 to user: Instance 89809460-5d38-4898-bd05-be5952139ea4 could not be found. {{(pid=102212) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 12 15:00:54.792981 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-72434c1e-0376-48ca-a13f-621405da878b tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] 10.222.0.49 "GET /compute/v2.1/servers/89809460-5d38-4898-bd05-be5952139ea4" status: 404 len: 111 microversion: 2.1 time: 0.064146 May 12 15:00:54.793509 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 570/1155] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 15:00:54 2022] GET /compute/v2.1/servers/89809460-5d38-4898-bd05-be5952139ea4 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 15:00:55.894488 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-6a7c6fff-4a8b-44ab-814b-a97e004efe56 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Calling method '>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:00:55.895025 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.compute.api [None req-6a7c6fff-4a8b-44ab-814b-a97e004efe56 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] [instance: 12704ca3-a417-4cab-9a2c-98b9275218eb] Fetching instance by UUID {{(pid=102213) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 15:00:55.902139 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-6a7c6fff-4a8b-44ab-814b-a97e004efe56 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 15:00:55.902586 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-6a7c6fff-4a8b-44ab-814b-a97e004efe56 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 15:00:55.903406 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-6a7c6fff-4a8b-44ab-814b-a97e004efe56 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 15:00:55.903839 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG oslo_concurrency.lockutils [None req-6a7c6fff-4a8b-44ab-814b-a97e004efe56 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 15:00:55.953582 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.wsgi [None req-6a7c6fff-4a8b-44ab-814b-a97e004efe56 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] HTTP exception thrown: Instance 12704ca3-a417-4cab-9a2c-98b9275218eb could not be found. May 12 15:00:55.954181 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-6a7c6fff-4a8b-44ab-814b-a97e004efe56 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Returning 404 to user: Instance 12704ca3-a417-4cab-9a2c-98b9275218eb could not be found. {{(pid=102213) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 12 15:00:55.955041 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-6a7c6fff-4a8b-44ab-814b-a97e004efe56 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] 10.222.0.49 "DELETE /compute/v2.1/servers/12704ca3-a417-4cab-9a2c-98b9275218eb" status: 404 len: 111 microversion: 2.1 time: 0.064438 May 12 15:00:55.955593 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 586/1156] 10.222.0.49 () {58 vars in 1238 bytes} [Thu May 12 15:00:55 2022] DELETE /compute/v2.1/servers/12704ca3-a417-4cab-9a2c-98b9275218eb => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 12 15:00:55.963606 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-81485bb2-e456-4290-a458-bde8ef5d4345 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Calling method '>' {{(pid=102212) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:00:55.964223 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.compute.api [None req-81485bb2-e456-4290-a458-bde8ef5d4345 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] [instance: 12704ca3-a417-4cab-9a2c-98b9275218eb] Fetching instance by UUID {{(pid=102212) get /opt/stack/nova/nova/compute/api.py:2813}} May 12 15:00:55.971419 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-81485bb2-e456-4290-a458-bde8ef5d4345 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 15:00:55.971871 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-81485bb2-e456-4290-a458-bde8ef5d4345 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 15:00:55.972632 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-81485bb2-e456-4290-a458-bde8ef5d4345 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 12 15:00:55.973072 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG oslo_concurrency.lockutils [None req-81485bb2-e456-4290-a458-bde8ef5d4345 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Lock "da96a16e-7498-4758-9db5-c67f00079eae" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102212) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 12 15:00:56.024759 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.wsgi [None req-81485bb2-e456-4290-a458-bde8ef5d4345 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] HTTP exception thrown: Instance 12704ca3-a417-4cab-9a2c-98b9275218eb could not be found. May 12 15:00:56.025344 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: DEBUG nova.api.openstack.wsgi [None req-81485bb2-e456-4290-a458-bde8ef5d4345 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Returning 404 to user: Instance 12704ca3-a417-4cab-9a2c-98b9275218eb could not be found. {{(pid=102212) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 12 15:00:56.026158 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO nova.api.openstack.requestlog [None req-81485bb2-e456-4290-a458-bde8ef5d4345 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] 10.222.0.49 "GET /compute/v2.1/servers/12704ca3-a417-4cab-9a2c-98b9275218eb" status: 404 len: 111 microversion: 2.1 time: 0.066244 May 12 15:00:56.026678 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: [pid: 102212|app: 0|req: 571/1157] 10.222.0.49 () {58 vars in 1235 bytes} [Thu May 12 15:00:55 2022] GET /compute/v2.1/servers/12704ca3-a417-4cab-9a2c-98b9275218eb => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 12 15:00:58.006476 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: DEBUG nova.api.openstack.wsgi [None req-f9709bf6-e875-46e1-b730-ff6b94b78425 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] Calling method '.version_select at 0x7ff7804aa430>' {{(pid=102213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 12 15:00:58.082820 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO nova.api.openstack.requestlog [None req-f9709bf6-e875-46e1-b730-ff6b94b78425 tempest-TestVolumeBootPattern-1941168067 tempest-TestVolumeBootPattern-1941168067-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1481799217" status: 202 len: 0 microversion: 2.1 time: 0.080187 May 12 15:00:58.083455 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: [pid: 102213|app: 0|req: 587/1158] 10.222.0.49 () {58 vars in 1262 bytes} [Thu May 12 15:00:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1481799217 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 12 15:01:52.564117 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 15:01:52.564854 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: Thu May 12 15:01:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 15:03:09.645626 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 15:03:09.646118 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: Thu May 12 15:03:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 15:03:20.594776 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 15:03:20.595519 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: Thu May 12 15:03:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 15:03:28.086902 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 15:03:28.087597 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: Thu May 12 15:03:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 15:03:41.359211 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 15:03:41.365872 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: Thu May 12 15:03:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 15:05:09.922024 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 15:05:09.922719 dv-cinder-831187-2-iscsi devstack@n-api.service[102212]: Thu May 12 15:05:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 12 15:05:12.572274 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 12 15:05:12.572775 dv-cinder-831187-2-iscsi devstack@n-api.service[102213]: Thu May 12 15:05:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!